00000001:02000400:1.0F:1790771876.612359:0:2956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1790771889.943604:0:3170:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1790771891.552455:0:3233:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 521 MB/s 00000001:01000000:3.0F:1790771891.803155:0:3233:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 675 MB/s 00000001:01000000:2.0F:1790771892.052757:0:3233:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8787 MB/s 00000020:02000000:2.0:1790771892.642427:0:3262:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_3_gf57cca5 00000400:02000000:3.0:1790771893.433925:0:3277:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.127@tcp [8/256/0/180] 00008000:02000000:3.0:1790771896.886806:0:3426:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1790771953.211751:0:5232:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790771964.902798:0:5804:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790771964.902805:0:5804:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1790771964.903123:0:5804:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ca3aaba3 00000080:02000400:0.0:1790771964.903138:0:5804:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:0.0:1790771964.910661:0:5804:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1790771964.910680:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790771964.910720:0:5804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000721846b3) 00000020:00000080:0.0:1790771964.910745:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790771964.934597:0:5804:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790771964.935183:0:5804:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790771964.955032:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790771964.955080:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790771964.955102:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790771964.955157:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790771964.955183:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790771964.956464:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790771964.956477:0:5804:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790771964.956491:0:5804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a8fb4f 00000020:01000004:3.0:1790771964.956500:0:5804:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790771964.956506:0:5804:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790771964.956511:0:5804:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ca3aaba3 from MGS 00000020:01000004:3.0:1790771964.956516:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790771964.956542:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a8114fbd) 00000020:00000080:3.0:1790771964.956587:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790771964.956711:0:5804:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ca3aaba3 from MGS, refs=2 00080000:01000000:3.0:1790771964.956717:0:5804:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790771964.956723:0:5804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a8fb5d 00000100:00100000:3.0:1790771964.956857:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790771964.957314:0:5804:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790771964.957322:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790771964.957996:0:5804:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790771964.958004:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790771964.960136:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790771964.960346:0:5804:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790771964.960353:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790771964.962223:0:5804:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790771964.962240:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790771964.972337:0:5804:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790771964.972356:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790771964.974438:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771964.974445:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771964.974447:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771964.975109:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771964.975113:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771964.975115:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771964.977430:0:5804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790771964.984129:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790771965.226454:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2483 MB/s 00000001:01000000:2.0:1790771965.476018:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2251 MB/s 00000001:01000000:3.0:1790771965.726080:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 443 MB/s 00000001:01000000:3.0:1790771965.977078:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 717 MB/s 00010000:00010000:0.0:1790771965.984868:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1790771965.989362:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1790771966.030883:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1790771966.030903:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790771966.030906:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1790771966.041345:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790771966.043405:0:5804:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790771966.043493:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1790771966.043903:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790771966.043934:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790771966.044358:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790771966.044578:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790771966.044585:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790771966.045506:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790771966.045517:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790771966.046923:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790771966.046935:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790771966.052074:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790771966.052101:0:5804:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.127@tcp' 00000020:01000004:1.0:1790771966.052104:0:5804:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790771966.052166:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.127@tcp (typ=mgc) 00000100:00080000:0.0:1790771966.053665:0:5819:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1790771966.054007:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.127@tcp (0000000096c3e3eb) 00000020:00000080:1.0:1790771966.054042:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790771966.054205:0:5804:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ae99bc0a@MGC192.168.206.127@tcp: add connection 192.168.206.127@tcp at head 00010000:00010000:1.0:1790771966.054398:0:5804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.127@tcp-0 is initialized 00000040:01000000:1.0:1790771966.054406:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 1 is initialized 10000000:01000000:2.0:1790771966.071395:0:5820:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790771966.073737:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.127@tcp (uuid 6f9eb452-8c57-4388-9743-b6ab49eaf81d) 00000020:00000080:1.0:1790771966.073766:0:5804:0:(genops.c:1384:class_connect()) connect: client 6f9eb452-8c57-4388-9743-b6ab49eaf81d, cookie 0xdf68d9a7d6a8fb6b 00000100:00080000:1.0:1790771966.073787:0:5804:0:(import.c:545:import_select_connection()) MGC192.168.206.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790771966.073797:0:5804:0:(import.c:666:import_select_connection()) MGC192.168.206.127@tcp: import 00000000ae99bc0a using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1790771966.073852:0:5804:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000942fdf6f x1877760428474496/t0(0) o250->MGC192.168.206.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790771966.073885:0:5804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6f9eb452-8c57-4388-9743-b6ab49eaf81d->MGS 00000020:01000004:1.0:1790771966.073905:0:5804:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790771966.073910:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790771966.073924:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d9069bce) 00000020:00000080:1.0:1790771966.073934:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790771966.074242:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000942fdf6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3292:1877760428474496:0@lo:250: 00000100:00100000:2.0:1790771966.074343:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771966.074445:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428474496 00000100:00100000:2.0:1790771966.074454:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428474496 00000100:00100000:2.0:1790771966.074507:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790771966.074514:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000dfba506f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3292:x1877760428474496:12345-0@lo:250: 00010000:00080000:2.0:1790771966.074542:0:5816:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6f9eb452-8c57-4388-9743-b6ab49eaf81d@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:2.0:1790771966.074597:0:5816:0:(genops.c:1384:class_connect()) connect: client 6f9eb452-8c57-4388-9743-b6ab49eaf81d, cookie 0xdf68d9a7d6a8fb79 00000100:00080000:2.0:1790771966.074773:0:5816:0:(import.c:65:import_set_state_nolock()) 00000000d5ab6db0 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790771966.074831:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000dfba506f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:3292:x1877760428474496:12345-0@lo:250: Request processed in 316us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771966.074838:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790771966.075111:0:3292:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790771966.075121:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.127@tcp: connect to target with instance 0 00000100:00080000:2.0:1790771966.075128:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790771966.075134:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790771966.075137:0:3292:0:(import.c:65:import_set_state_nolock()) 00000000ae99bc0a MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790771966.075140:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790771966.075148:0:3292:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790771966.075155:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000942fdf6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3292:1877760428474496:0@lo:250: 00000100:00100000:1.0:1790771966.093166:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790771966.093390:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790771966.093395:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790771966.107312:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790771966.107334:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790771966.108989:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790771966.109003:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790771966.110267:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790771966.111110:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790771966.111130:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790771966.112768:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790771966.112792:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790771966.209730:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790771966.209993:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790771966.210000:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790771966.216921:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790771966.216943:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790771966.222302:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790771966.222499:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790771966.222506:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790771966.224245:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790771966.224271:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790771966.227099:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790771966.227328:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790771966.227335:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790771966.230577:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790771966.230682:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790771966.239871:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790771966.240211:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790771966.240217:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790771966.241041:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790771966.241052:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790771966.281241:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790771966.281476:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790771966.281484:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790771966.286857:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790771966.286877:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790771966.292367:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790771966.292385:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790771966.294280:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790771966.294311:0:5804:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1790771966.294318:0:5804:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790771966.294490:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790771966.294532:0:5804:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.127@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1790771966.294538:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790771966.294540:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790771966.294541:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790771966.294542:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790771966.294543:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790771966.294545:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790771966.294546:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790771966.294755:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790771966.294757:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790771966.294758:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790771966.294760:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790771966.294762:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790771966.294765:0:5804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1790771966.294768:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790771966.294769:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790771966.294770:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790771966.294771:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790771966.294773:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790771966.294774:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790771966.294775:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790771966.294776:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790771966.294777:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790771966.294785:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790771966.294786:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790771966.294787:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790771966.294829:0:5804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790771966.294848:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e23b8da4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428474624:0@lo:253: 00000100:00100000:2.0:1790771966.294931:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771966.295051:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b33900b going to sleep for 11 seconds 00000100:00100000:3.0:1790771966.297995:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428474624 00000100:00100000:3.0:1790771966.298016:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428474624 00000100:00100000:3.0:1790771966.298080:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790771966.298089:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007353c25d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:5804:x1877760428474624:12345-0@lo:253: 20000000:01000000:3.0:1790771966.298161:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790771966.298165:0:5818:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1790771966.301911:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790771966.301998:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1790771966.302350:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790771966.303885:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1790771966.304387:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790771966.304394:0:5818:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1790771966.304411:0:5818:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1790771966.304415:0:5818:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1790771966.304436:0:5818:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1790771966.305387:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790771966.308543:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1790771966.308726:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790771966.308811:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1790771966.308867:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1790771966.308908:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1790771966.309255:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1790771966.309265:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1790771966.309311:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1790771966.309319:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1790771966.309348:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1790771966.309355:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1790771966.309382:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1790771966.309426:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1790771966.309463:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790771966.309471:0:5818:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1790771966.309484:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790771966.310320:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1790771966.310341:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790771966.310387:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1790771966.310424:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1790771966.310486:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1790771966.310502:0:5818:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1790771966.311846:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1790771966.311867:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790771966.311928:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1790771966.311980:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1790771966.312013:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1790771966.312508:0:5818:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1790771966.312982:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1790771966.312996:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1790771966.313955:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1790771966.314195:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1790771966.314434:0:5818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1790771966.314484:0:5818:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1790771966.314494:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1790771966.317764:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1790771966.318256:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1790771966.318292:0:5818:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.127@tcp for mdt 20000000:01000000:3.0:1790771966.318295:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.127@tcp (null) (null) (null) 00000040:00080000:3.0:1790771966.318333:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1790771966.318342:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790771966.318373:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1790771966.318382:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.127@tcp (null) (null) 00000040:00080000:3.0:1790771966.318448:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1790771966.318460:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1790771966.318495:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1790771966.318531:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1790771966.329398:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790771966.329408:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790771966.329413:0:5818:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790771966.329429:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790771966.329432:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790771966.329466:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790771966.329469:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790771966.330428:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1790771966.331996:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1790771966.332208:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1790771966.332247:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1790771966.332261:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790771966.332264:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790771966.335411:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1790771966.336288:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1790771966.336347:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1790771966.336430:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1790771966.336447:0:5818:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790771966.336450:0:5818:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1790771966.336457:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790771966.336460:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790771966.336467:0:5818:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1790771966.336475:0:5818:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790771966.342976:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1790771966.343186:0:5818:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1790771966.361711:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1790771966.361906:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1790771966.362408:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1790771966.362435:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790771966.362456:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.362472:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.362501:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.362507:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.362512:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.362518:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.362525:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008678d14 already unused, calling callback (00000000fb822f35) 00010000:00010000:2.0:1790771966.362528:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.362535:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.362545:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.362578:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.362585:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008678d14/0xdf68d9a7d6a8fb80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790771966.362605:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790771966.750754:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007353c25d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:5804:x1877760428474624:12345-0@lo:253: Request processed in 452654us (455812us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771966.750773:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790771966.750912:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e23b8da4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428474624:0@lo:253: 10000000:01000000:2.0:1790771966.751006:0:5804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790771966.751010:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790771966.751012:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790771966.751013:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790771966.751014:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1790771966.751016:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790771966.751017:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790771966.751018:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790771966.751020:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790771966.751021:0:5804:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790771966.751023:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790771966.751024:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790771966.751049:0:5804:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ca3aaba3 from lustre-MDT0000 10000000:01000000:2.0:1790771966.751078:0:5804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790771966.751081:0:5804:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790771966.751085:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8df258e04d40 10000000:01000000:2.0:1790771966.751089:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790771966.751098:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df258e04d40 from 1 10000000:01000000:2.0:1790771966.751101:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790771966.751146:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 0000000008678d14/0xdf68d9a7d6a8fb87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.751157:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 0000000008678d14/0xdf68d9a7d6a8fb87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771966.751166:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 0000000008678d14/0xdf68d9a7d6a8fb87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771966.751184:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e23b8da4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428474752:0@lo:101: 00000100:00100000:2.0:1790771966.751226:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771966.751390:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c010ed1 going to sleep for 11 seconds 00000100:00100000:3.0:1790771966.751498:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428474752 00000100:00100000:3.0:1790771966.751506:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428474752 00000100:00100000:3.0:1790771966.751742:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790771966.751751:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d6095a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:5804:x1877760428474752:12345-0@lo:101: 00010000:00010000:3.0:1790771966.751770:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771966.751786:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004b94c58d/0xdf68d9a7d6a8fb8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fb87 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771966.751811:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004b94c58d/0xdf68d9a7d6a8fb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fb87 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771966.751821:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004b94c58d/0xdf68d9a7d6a8fb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fb87 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771966.751841:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004b94c58d, rc 0) 00000100:00100000:3.0:1790771966.751896:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d6095a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+6:5804:x1877760428474752:12345-0@lo:101: Request processed in 146us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771966.751903:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790771966.751993:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e23b8da4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428474752:0@lo:101: 00010000:00010000:0.0:1790771966.752009:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 0000000008678d14/0xdf68d9a7d6a8fb87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771966.752017:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 0000000008678d14/0xdf68d9a7d6a8fb87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771966.752084:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002015e42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428474880:0@lo:501: 00000100:00100000:0.0:1790771966.752124:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771966.752391:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036f12f64 going to sleep for 11 seconds 00000100:00100000:2.0:1790771966.752449:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428474880 00000100:00100000:2.0:1790771966.752455:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428474880 00000100:00100000:1.0:1790771966.752516:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790771966.752537:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006ad68720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+6:5804:x1877760428474880:12345-0@lo:501: 00000100:00100000:1.0:1790771966.752843:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006ad68720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+6:5804:x1877760428474880:12345-0@lo:501: Request processed in 318us (719us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790771966.752852:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790771966.753063:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002015e42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428474880:0@lo:501: 10000000:01000000:0.0:1790771966.753093:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790771966.753116:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 0000000008678d14/0xdf68d9a7d6a8fb87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771966.753125:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 0000000008678d14/0xdf68d9a7d6a8fb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790771966.753137:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df258965000 10000000:01000000:0.0:1790771966.753141:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790771966.753145:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df258965000 10000000:01000000:0.0:1790771966.753148:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790771966.753150:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df258965000 from 1 10000000:01000000:0.0:1790771966.753153:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790771966.753180:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 00000000830a35d7/0xdf68d9a7d6a8fb95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771966.753188:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 00000000830a35d7/0xdf68d9a7d6a8fb95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771966.753203:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 00000000830a35d7/0xdf68d9a7d6a8fb95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771966.753219:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002015e42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475008:0@lo:101: 00000100:00100000:0.0:1790771966.753250:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771966.753284:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036f12f64 going to sleep for 11 seconds 00000100:00100000:1.0:1790771966.753401:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428475008 00000100:00100000:1.0:1790771966.753407:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428475008 00000100:00100000:1.0:1790771966.753432:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790771966.753438:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009b7593b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+6:5804:x1877760428475008:12345-0@lo:101: 00010000:00010000:1.0:1790771966.753447:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771966.753461:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000863041b1/0xdf68d9a7d6a8fb9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fb95 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771966.753481:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000863041b1/0xdf68d9a7d6a8fb9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fb95 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771966.753491:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000863041b1/0xdf68d9a7d6a8fb9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fb95 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771966.753506:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000863041b1, rc 0) 00000100:00100000:1.0:1790771966.753545:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009b7593b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+7:5804:x1877760428475008:12345-0@lo:101: Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771966.753865:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002015e42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475008:0@lo:101: 00010000:00010000:0.0:1790771966.753879:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 00000000830a35d7/0xdf68d9a7d6a8fb95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771966.753887:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 00000000830a35d7/0xdf68d9a7d6a8fb95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790771966.753900:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790771966.753909:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 00000000830a35d7/0xdf68d9a7d6a8fb95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771966.753916:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 00000000830a35d7/0xdf68d9a7d6a8fb95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790771966.754003:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790771966.754008:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790771966.754014:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df258965000 10000000:01000000:0.0:1790771966.754017:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790771966.754020:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1790771966.754022:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790771966.754038:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 000000002fa6f755/0xdf68d9a7d6a8fba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771966.754051:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 000000002fa6f755/0xdf68d9a7d6a8fba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771966.754058:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 000000002fa6f755/0xdf68d9a7d6a8fba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771966.754069:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002015e42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475136:0@lo:101: 00000100:00100000:0.0:1790771966.754097:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771966.754114:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036f12f64 going to sleep for 11 seconds 00000100:00100000:1.0:1790771966.754177:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790771966.754204:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428475136 00000100:00100000:1.0:1790771966.754208:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428475136 00000100:00100000:1.0:1790771966.754225:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790771966.754229:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002db40692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+7:5804:x1877760428475136:12345-0@lo:101: 00010000:00010000:1.0:1790771966.754236:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771966.754243:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e9dd145/0xdf68d9a7d6a8fbaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fba3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771966.754257:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e9dd145/0xdf68d9a7d6a8fbaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fba3 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771966.754263:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e9dd145/0xdf68d9a7d6a8fbaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fba3 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771966.754328:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e9dd145, rc 0) 00000100:00100000:1.0:1790771966.754367:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002db40692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+8:5804:x1877760428475136:12345-0@lo:101: Request processed in 137us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771966.754373:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790771966.754538:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002015e42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475136:0@lo:101: 00010000:00010000:0.0:1790771966.754729:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 000000002fa6f755/0xdf68d9a7d6a8fba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771966.754738:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 000000002fa6f755/0xdf68d9a7d6a8fba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771966.754792:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002015e42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475264:0@lo:501: 00000100:00100000:0.0:1790771966.754835:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771966.754865:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036f12f64 going to sleep for 11 seconds 00000100:00100000:3.0:1790771966.755025:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428475264 00000100:00100000:3.0:1790771966.755031:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428475264 00000100:00100000:3.0:1790771966.755057:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790771966.755062:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005a15e65e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+8:5804:x1877760428475264:12345-0@lo:501: 00000100:00100000:0.0:1790771966.756053:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005a15e65e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:5804:x1877760428475264:12345-0@lo:501: Request processed in 984us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771966.756069:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790771966.756144:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002015e42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475264:0@lo:501: 00000100:00100000:2.0:1790771966.756193:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475392:0@lo:503: 00000100:00100000:2.0:1790771966.756241:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771966.756604:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd5cfee6 going to sleep for 11 seconds 00000100:00100000:0.0:1790771966.756828:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428475392 00000100:00100000:0.0:1790771966.756836:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428475392 00000100:00100000:0.0:1790771966.756985:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790771966.756995:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000073ce8c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:5804:x1877760428475392:12345-0@lo:503: 00000100:00100000:0.0:1790771966.757209:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000073ce8c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:5804:x1877760428475392:12345-0@lo:503: Request processed in 217us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771966.757221:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790771966.757320:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475392:0@lo:503: 00000100:00100000:2.0:1790771966.757896:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5846:1877760428475520:0@lo:502: 00000100:00100000:2.0:1790771966.757959:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771966.758251:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 00000000732e2027 going to sleep for 11 seconds 00000100:00100000:1.0:1790771966.758356:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428475520 00000100:00100000:1.0:1790771966.758364:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428475520 00000100:00100000:1.0:1790771966.758399:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790771966.758406:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c6937f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:5846:x1877760428475520:12345-0@lo:502: 00000100:00100000:1.0:1790771966.758829:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c6937f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:5846:x1877760428475520:12345-0@lo:502: Request processed in 422us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771966.758843:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790771966.759042:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5846:1877760428475520:0@lo:502: 00000020:01000000:2.0:1790771966.759071:0:5846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790771966.759085:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790771966.759087:0:5846:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790771966.759092:0:5846:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790771966.759095:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790771966.759117:0:5846:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005f324954) 00000020:00000080:2.0:1790771966.759138:0:5846:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790771966.759145:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790771966.759237:0:5846:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790771966.759247:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a8fbb8 00000020:00000080:2.0:1790771966.759774:0:5846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790771966.759780:0:5846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790771966.759785:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790771966.759787:0:5846:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790771966.759789:0:5846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790771966.759793:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790771966.759794:0:5846:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790771966.759797:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790771966.759803:0:5846:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bbd36afd) 00000020:00000080:2.0:1790771966.759815:0:5846:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790771966.759825:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790771966.759827:0:5846:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790771966.759830:0:5846:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790771966.759850:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790771966.759903:0:5846:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ca3aaba3 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790771966.759914:0:5846:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f9be2ebf) 00000020:00000080:2.0:1790771966.760046:0:5846:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790771966.760105:0:5846:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790771966.760113:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf68d9a7d6a8fbcd 00000020:00000080:2.0:1790771966.760221:0:5846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790771966.760227:0:5846:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790771966.760231:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdf68d9a7d6a8fbd4 00080000:01000000:2.0:1790771966.760237:0:5846:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790771966.760240:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a8fbdb 00080000:10000000:2.0:1790771966.763170:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1790771966.763467:0:5846:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1790771966.774494:0:5846:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1790771966.874459:0:5846:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1790771966.875130:0:5846:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1790771966.885593:0:5846:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1790771966.887529:0:5846:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790771966.931523:0:5846:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fce41ae2) 00000020:00000080:1.0:1790771966.931629:0:5846:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790771966.931721:0:5846:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790771966.931730:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a8fbe9 00000020:00000080:1.0:1790771966.932235:0:5846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1790771966.934057:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790771966.973409:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790771967.003073:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:2.0:1790771967.016390:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1790771967.066320:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790771967.117501:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790771967.159053:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1790771967.207865:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdf68d9a7d6a8fbf0 00000020:00000080:3.0:1790771967.208677:0:5846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790771967.208691:0:5846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790771967.208697:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790771967.208700:0:5846:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790771967.208703:0:5846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790771967.208707:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790771967.208708:0:5846:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790771967.208711:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790771967.208713:0:5846:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790771967.208716:0:5846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790771967.208718:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790771967.208720:0:5846:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790771967.208722:0:5846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790771967.208726:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790771967.208727:0:5846:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790771967.208731:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790771967.208773:0:5846:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1790771967.208848:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b05e59b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5846:1877760428475648:0@lo:502: 00000100:00100000:3.0:1790771967.208967:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771967.209017:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f69014e9 going to sleep for 11 seconds 00000100:00100000:0.0:1790771967.209150:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428475648 00000100:00100000:0.0:1790771967.209159:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428475648 00000100:00100000:0.0:1790771967.209209:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790771967.209218:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fc9953b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:5846:x1877760428475648:12345-0@lo:502: 00000100:00100000:0.0:1790771967.209708:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fc9953b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:5846:x1877760428475648:12345-0@lo:502: Request processed in 488us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771967.209717:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790771967.209886:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b05e59b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5846:1877760428475648:0@lo:502: 00000020:01000000:3.0:1790771967.209990:0:5846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790771967.209998:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790771967.210000:0:5846:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1790771967.210004:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1790771967.211374:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1790771967.211413:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790771967.211437:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 000000002fa6f755/0xdf68d9a7d6a8fba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771967.211452:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 000000002fa6f755/0xdf68d9a7d6a8fba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790771967.211460:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df258965000 from 1 10000000:01000000:2.0:1790771967.211463:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790771967.211524:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771967.211532:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771967.211543:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771967.211846:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475776:0@lo:101: 00000100:00100000:2.0:1790771967.211911:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771967.212042:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b83f8d9 going to sleep for 11 seconds 00000100:00100000:1.0:1790771967.212087:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428475776 00000100:00100000:1.0:1790771967.212096:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428475776 00000100:00100000:1.0:1790771967.212172:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790771967.212181:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e60169b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:5804:x1877760428475776:12345-0@lo:101: 00010000:00010000:1.0:1790771967.212199:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771967.212215:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009beb6ab0/0xdf68d9a7d6a8fbfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fbf7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771967.212241:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009beb6ab0/0xdf68d9a7d6a8fbfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fbf7 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771967.212251:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009beb6ab0/0xdf68d9a7d6a8fbfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fbf7 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771967.212260:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009beb6ab0, rc 0) 00000100:00100000:1.0:1790771967.212318:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e60169b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+10:5804:x1877760428475776:12345-0@lo:101: Request processed in 138us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771967.212325:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790771967.212410:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475776:0@lo:101: 00010000:00010000:2.0:1790771967.212423:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771967.212431:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771967.213047:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475904:0@lo:256: 00000100:00100000:2.0:1790771967.213094:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771967.213716:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b83f8d9 going to sleep for 11 seconds 00000100:00100000:0.0:1790771967.213756:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428475904 00000100:00100000:0.0:1790771967.213765:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428475904 00000100:00100000:3.0:1790771967.213828:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790771967.213840:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000008a678c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+10:5804:x1877760428475904:12345-0@lo:256: 20000000:01000000:3.0:1790771967.213862:0:5816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790771967.213869:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790771967.213981:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000008a678c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+10:5804:x1877760428475904:12345-0@lo:256: Request processed in 144us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771967.213989:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790771967.214124:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428475904:0@lo:256: 10000000:01000000:2.0:1790771967.214863:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790771967.214887:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771967.214900:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790771967.214987:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df258965000 from 1 10000000:01000000:2.0:1790771967.214991:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790771967.215029:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771967.215038:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771967.215048:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771967.215067:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476032:0@lo:101: 00000100:00100000:2.0:1790771967.215114:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771967.215144:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b83f8d9 going to sleep for 11 seconds 00000100:00100000:1.0:1790771967.215211:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428476032 00000100:00100000:1.0:1790771967.215218:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428476032 00000100:00100000:1.0:1790771967.215257:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790771967.215272:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004072d1a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+10:5804:x1877760428476032:12345-0@lo:101: 00010000:00010000:1.0:1790771967.215286:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771967.215299:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a6186bf9/0xdf68d9a7d6a8fc0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fc05 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771967.215324:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a6186bf9/0xdf68d9a7d6a8fc0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc05 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771967.215335:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a6186bf9/0xdf68d9a7d6a8fc0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc05 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771967.215343:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a6186bf9, rc 0) 00000100:00100000:1.0:1790771967.215390:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004072d1a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:5804:x1877760428476032:12345-0@lo:101: Request processed in 120us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771967.215397:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790771967.215721:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476032:0@lo:101: 00010000:00010000:2.0:1790771967.215736:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771967.215745:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771967.215800:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476160:0@lo:501: 00000100:00100000:2.0:1790771967.215830:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771967.215848:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b83f8d9 going to sleep for 11 seconds 00000100:00100000:1.0:1790771967.215899:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428476160 00000100:00100000:1.0:1790771967.215903:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428476160 00000100:00100000:1.0:1790771967.215939:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790771967.215946:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c32032b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:5804:x1877760428476160:12345-0@lo:501: 00000100:00100000:1.0:1790771967.218768:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c32032b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:5804:x1877760428476160:12345-0@lo:501: Request processed in 2812us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771967.218785:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790771967.219209:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476160:0@lo:501: 00000100:00100000:2.0:1790771967.219278:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476288:0@lo:503: 00000100:00100000:2.0:1790771967.219355:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771967.229123:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b83f8d9 going to sleep for 11 seconds 00000100:00100000:1.0:1790771967.234363:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428476288 00000100:00100000:1.0:1790771967.234384:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428476288 00000100:00100000:1.0:1790771967.234449:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790771967.234459:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ba079749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:5804:x1877760428476288:12345-0@lo:503: 00000040:00080000:1.0:1790771967.234537:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790771967.234669:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ba079749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:5804:x1877760428476288:12345-0@lo:503: Request processed in 211us (15314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771967.234683:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790771967.234741:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f72607a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476288:0@lo:503: 00000040:00080000:3.0:1790771967.239160:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1790771967.239284:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790771967.239309:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790771967.239334:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.239349:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790771967.239402:0:5804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790771967.239405:0:5804:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df258965000 10000000:01000000:0.0:1790771967.239408:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df258965000 10000000:01000000:0.0:1790771967.239412:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790771967.239418:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df258965000 from 1 10000000:01000000:0.0:1790771967.239421:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790771967.239463:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 00000000e6b1a32c/0xdf68d9a7d6a8fc13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.239484:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 00000000e6b1a32c/0xdf68d9a7d6a8fc13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.239497:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 00000000e6b1a32c/0xdf68d9a7d6a8fc13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771967.239521:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003b7d778 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476416:0@lo:101: 00000100:00100000:0.0:1790771967.239691:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771967.239737:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036f12f64 going to sleep for 11 seconds 00000100:00100000:3.0:1790771967.239828:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428476416 00000100:00100000:3.0:1790771967.239838:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428476416 00000100:00100000:3.0:1790771967.239898:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790771967.239907:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000064318de1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:5804:x1877760428476416:12345-0@lo:101: 00010000:00010000:3.0:1790771967.239935:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771967.239949:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f17aaf3b/0xdf68d9a7d6a8fc1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fc13 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771967.239974:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f17aaf3b/0xdf68d9a7d6a8fc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc13 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771967.239998:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f17aaf3b/0xdf68d9a7d6a8fc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc13 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771967.240008:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f17aaf3b, rc 0) 00000100:00100000:3.0:1790771967.240060:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000064318de1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5804:x1877760428476416:12345-0@lo:101: Request processed in 154us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771967.240071:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790771967.240209:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003b7d778 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476416:0@lo:101: 00010000:00010000:0.0:1790771967.240228:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 00000000e6b1a32c/0xdf68d9a7d6a8fc13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.240237:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 00000000e6b1a32c/0xdf68d9a7d6a8fc13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771967.241107:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003b7d778 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476544:0@lo:501: 00000100:00100000:0.0:1790771967.241180:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771967.241220:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036f12f64 going to sleep for 11 seconds 00000100:00100000:1.0:1790771967.241412:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428476544 00000100:00100000:1.0:1790771967.241420:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428476544 00000100:00100000:1.0:1790771967.241474:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790771967.241482:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b828cff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5804:x1877760428476544:12345-0@lo:501: 00000100:00100000:1.0:1790771967.242177:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b828cff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5804:x1877760428476544:12345-0@lo:501: Request processed in 693us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771967.242187:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790771967.242426:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003b7d778 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476544:0@lo:501: 00000100:00100000:0.0:1790771967.242475:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003b7d778 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476672:0@lo:503: 00000100:00100000:0.0:1790771967.242534:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771967.242601:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036f12f64 going to sleep for 11 seconds 00000100:00100000:3.0:1790771967.242722:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428476672 00000100:00100000:3.0:1790771967.242729:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428476672 00000100:00100000:3.0:1790771967.242765:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790771967.242772:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000987b8b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5804:x1877760428476672:12345-0@lo:503: 00000100:00100000:3.0:1790771967.243131:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000987b8b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5804:x1877760428476672:12345-0@lo:503: Request processed in 358us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771967.243139:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790771967.243610:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003b7d778 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428476672:0@lo:503: 00000100:00100000:3.0:1790771967.244163:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b05e59b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5851:1877760428476800:0@lo:502: 00000100:00100000:3.0:1790771967.244223:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771967.244261:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set 0000000096195edf going to sleep for 11 seconds 00000100:00100000:1.0:1790771967.244315:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428476800 00000100:00100000:1.0:1790771967.244323:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428476800 00000100:00100000:1.0:1790771967.244365:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790771967.244373:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000047531abb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5851:x1877760428476800:12345-0@lo:502: 00000100:00100000:1.0:1790771967.244898:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000047531abb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5851:x1877760428476800:12345-0@lo:502: Request processed in 525us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771967.244906:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790771967.249893:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b05e59b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5851:1877760428476800:0@lo:502: 00000020:01000004:3.0:1790771967.250935:0:5851:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790771967.250954:0:5851:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a7f0b12d) 00000020:00000080:3.0:1790771967.250978:0:5851:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1790771967.251070:0:5851:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ca3aaba3 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790771967.251074:0:5851:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ca3aaba3 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790771967.251077:0:5851:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ca3aaba3 4 00010000:00080000:3.0:1790771967.251108:0:5851:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e3bb2871@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:3.0:1790771967.252967:0:5851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1790771967.253209:0:5851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790771967.253246:0:5851:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790771967.253260:0:5851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdf68d9a7d6a8fc28 00000100:00080000:3.0:1790771967.253271:0:5851:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790771967.253282:0:5851:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e3bb2871 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1790771967.253325:0:5851:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009b05e59b x1877760428476928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790771967.258717:0:5851:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790771967.264817:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b05e59b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877760428476928:0@lo:38: 00000100:00100000:3.0:1790771967.264930:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771967.266122:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428476928 00000100:00100000:0.0:1790771967.266137:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428476928 00000100:00100000:0.0:1790771967.266182:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790771967.266197:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001bbe64f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1877760428476928:12345-0@lo:38: 00000100:00100000:0.0:1790771967.266299:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001bbe64f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1877760428476928:12345-0@lo:38: Request processed in 102us (1370us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790771967.266306:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790771967.266425:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790771967.266435:0:3292:0:(import.c:65:import_set_state_nolock()) 00000000e3bb2871 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790771967.266440:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790771967.266444:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b05e59b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877760428476928:0@lo:38: 00000100:00100000:3.0:1790771967.271404:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b05e59b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5851:1877760428477056:0@lo:502: 00000100:00100000:3.0:1790771967.271525:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771967.271613:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set 0000000001352ba1 going to sleep for 11 seconds 00000100:00100000:0.0:1790771967.271741:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428477056 00000100:00100000:0.0:1790771967.271751:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428477056 00000100:00100000:0.0:1790771967.271806:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790771967.271815:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b732afcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5851:x1877760428477056:12345-0@lo:502: 00000100:00100000:0.0:1790771967.272094:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b732afcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5851:x1877760428477056:12345-0@lo:502: Request processed in 279us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771967.272103:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790771967.272662:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b05e59b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5851:1877760428477056:0@lo:502: 00000040:00080000:1.0:1790771967.272698:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1790771967.272774:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1790771967.272794:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790771967.272808:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 00000000e6b1a32c/0xdf68d9a7d6a8fc13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771967.272819:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 00000000e6b1a32c/0xdf68d9a7d6a8fc13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790771967.272875:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790771967.272877:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790771967.272879:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790771967.272880:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790771967.272881:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790771967.272883:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790771967.272884:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790771967.272886:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790771967.272887:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790771967.272888:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790771967.272890:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790771967.272891:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790771967.272895:0:5804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1790771967.272897:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790771967.272898:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790771967.272899:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790771967.272900:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790771967.272901:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790771967.272903:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790771967.272903:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790771967.272904:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790771967.272906:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790771967.272907:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790771967.272907:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790771967.272908:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790771967.273037:0:5804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790771967.273050:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4fb8e9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428477184:0@lo:253: 00000100:00100000:1.0:1790771967.273094:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771967.273113:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000001352ba1 going to sleep for 11 seconds 00000100:00100000:1.0:1790771967.273132:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428477184 00000100:00100000:1.0:1790771967.273139:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428477184 00000100:00100000:1.0:1790771967.273175:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790771967.273182:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000da301886 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5804:x1877760428477184:12345-0@lo:253: 20000000:01000000:1.0:1790771967.273219:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790771967.273239:0:5817:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790771967.327243:0:5817:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790771967.327267:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790771967.327386:0:5839:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790771967.327391:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790771967.327414:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771967.327437:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009beb6ab0/0xdf68d9a7d6a8fbfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fbf7 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771967.327446:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771967.327492:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009beb6ab0/0xdf68d9a7d6a8fbfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fbf7 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771967.327521:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009beb6ab0/0xdf68d9a7d6a8fbfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fbf7 expref: 12 pid: 5817 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771967.327538:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009dce26fd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5839:1877760428477312:0@lo:104: 00000100:00100000:3.0:1790771967.327708:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771967.327767:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a74b323c going to sleep for 11 seconds 00000100:00100000:1.0:1790771967.328929:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428477312 00000100:00100000:1.0:1790771967.328942:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428477312 00000100:00100000:1.0:1790771967.328997:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790771967.329007:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000000eee7aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:5839:x1877760428477312:12345-0@lo:104: 00010000:00010000:1.0:1790771967.329025:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771967.329103:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790771967.329109:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000000eee7aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:5839:x1877760428477312:12345-0@lo:104: Request processed in 105us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771967.329116:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790771967.329165:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009dce26fd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5839:1877760428477312:0@lo:104: 00010000:00010000:1.0:1790771967.329187:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.329844:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790771967.329852:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.329861:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000084a76fd3 already unused, calling callback (00000000efa3677f) 10000000:00010000:0.0:1790771967.329866:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.329875:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790771967.329882:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790771967.329888:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790771967.330477:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.330488:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790771967.330529:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.330536:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: 0000000084a76fd3/0xdf68d9a7d6a8fbf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fbfe expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.330587:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771967.330589:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771967.330591:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771967.330662:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790771967.330678:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ace9901e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428477440:0@lo:103: 00000100:00100000:0.0:1790771967.330740:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771967.330804:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428477440 00000100:00100000:0.0:1790771967.330813:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428477440 00010000:00010000:0.0:1790771967.330841:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009beb6ab0/0xdf68d9a7d6a8fbfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fbf7 expref: 13 pid: 5817 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771967.330870:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790771967.330877:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004a2d317e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:3293:x1877760428477440:12345-0@lo:103: 00010000:00010000:0.0:1790771967.330890:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771967.330895:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009beb6ab0/0xdf68d9a7d6a8fbfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fbf7 expref: 13 pid: 5817 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.330905:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009beb6ab0/0xdf68d9a7d6a8fbfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fbf7 expref: 13 pid: 5817 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.330933:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009beb6ab0/0xdf68d9a7d6a8fbfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fbf7 expref: 13 pid: 5817 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.330951:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.330965:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790771967.330982:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003591187s 00010000:00010000:0.0:1790771967.330986:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.330992:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.330998:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.331004:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.331010:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b2eb85f9 already unused, calling callback (00000000fb822f35) 00010000:00010000:0.0:1790771967.331013:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.331020:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.331034:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.331044:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771967.331079:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004a2d317e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3293:x1877760428477440:12345-0@lo:103: Request processed in 202us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771967.331086:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790771967.331134:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ace9901e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428477440:0@lo:103: 00010000:00010000:0.0:1790771967.331156:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.331163:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771967.331169:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b2eb85f9/0xdf68d9a7d6a8fc2f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771967.340963:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000da301886 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:5804:x1877760428477184:12345-0@lo:253: Request processed in 67772us (67858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771967.340983:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790771967.341148:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4fb8e9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5804:1877760428477184:0@lo:253: 10000000:01000000:1.0:1790771967.341168:0:5804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790771967.341172:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790771967.341174:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790771967.341176:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790771967.341177:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790771967.341178:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790771967.341180:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790771967.341182:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790771967.341183:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790771967.341185:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790771967.341186:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790771967.341188:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790771967.341190:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790771967.341222:0:5804:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790771967.351101:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1790771967.351510:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790771967.351781:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1790771967.357317:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790771967.357676:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1790771967.357855:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790771967.375541:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1790771967.376172:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790771967.376750:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1790771967.377018:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1790771967.377218:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1790771967.377808:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1790771967.452097:0:5804:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1790771967.530247:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790771967.530324:0:5856:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1790771967.530328:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1790771967.530974:0:5857:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790771967.535176:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790771967.535396:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790771967.539492:0:5804:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790771967.539686:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790771967.540158:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790771967.541459:0:5804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790771967.542809:0:5804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790771967.542875:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790771967.543451:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790771967.543950:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1790771967.546801:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1790771967.552980:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1790771967.553446:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1790771967.554812:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1790771967.555010:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1790771967.555133:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1790771967.555271:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1790771967.555391:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1790771967.558201:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1790771967.558425:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1790771967.561895:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1790771967.563297:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1790771967.563444:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1790771967.569846:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1790771967.570158:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1790771967.570593:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1790771967.571007:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1790771967.571159:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1790771967.571988:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1790771967.572167:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1790771967.572780:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1790771967.572939:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1790771967.573077:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1790771967.573212:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1790771967.573614:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1790771967.573854:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1790771967.574027:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1790771967.574182:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1790771967.574720:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1790771967.574877:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1790771967.575017:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1790771967.575177:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1790771967.575395:0:5804:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1790771967.605890:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1790771967.699598:0:5804:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790771967.699651:0:5804:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa05941cab988 00100000:10000000:1.0:1790771967.699660:0:5804:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790771967.700950:0:5804:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790771967.700968:0:5804:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790771967.700988:0:5804:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1790771967.701017:0:5804:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1790771967.767318:0:5857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790771967.767405:0:5857:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790771967.767410:0:5857:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1790771968.033221:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771969.056988:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771970.080676:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771971.105826:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771972.129771:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790771972.583249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790771972.583262:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790771972.583265:0:36:0:(import.c:65:import_set_state_nolock()) 00000000e3bb2871 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790771972.583286:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e3bb2871 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1790771972.583353:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a5f121a3 x1877760428477696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790771972.583404:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5f121a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877760428477696:0@lo:38: 00000100:00100000:3.0:1790771972.583496:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771972.583608:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428477696 00000100:00100000:3.0:1790771972.583631:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428477696 00000100:00100000:3.0:1790771972.583672:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790771972.583680:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006bdca534 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1877760428477696:12345-0@lo:38: 00010000:00080000:3.0:1790771972.583710:0:5825:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:3.0:1790771972.583752:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdf68d9a7d6a8fc36 00000004:00100000:3.0:1790771972.583805:0:5825:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790771972.583978:0:5825:0:(import.c:65:import_set_state_nolock()) 00000000d4df0b88 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790771972.584232:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006bdca534 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877760428477696:12345-0@lo:38: Request processed in 551us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771972.584240:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790771972.584291:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a5f121a3 x1877760428477696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790771982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790771972.584307:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790771972.584333:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790771972.584338:0:3292:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790771972.584340:0:3292:0:(import.c:65:import_set_state_nolock()) 00000000e3bb2871 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790771972.584347:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5f121a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877760428477696:0@lo:38: 00000100:00100000:0.0:1790771972.584747:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790771972.584760:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000629ea8eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428477568:0@lo:400: 00000100:00100000:0.0:1790771972.584806:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771972.588287:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428477568 00000100:00100000:3.0:1790771972.588308:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428477568 00000100:00100000:3.0:1790771972.588385:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790771972.588395:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c5152fb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:3296:x1877760428477568:12345-0@lo:400: 00000100:00100000:3.0:1790771972.588511:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c5152fb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:3296:x1877760428477568:12345-0@lo:400: Request processed in 118us (3706us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771972.588520:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790771972.588695:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000629ea8eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428477568:0@lo:400: 10000000:01000000:0.0:1790771973.099260:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790771973.099270:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df258965000 from 3 10000000:01000000:0.0:1790771973.099276:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790771973.099332:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 000000001bbaf0f8/0xdf68d9a7d6a8fc3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771973.099347:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 000000001bbaf0f8/0xdf68d9a7d6a8fc3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771973.099360:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 000000001bbaf0f8/0xdf68d9a7d6a8fc3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771973.099387:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ace9901e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428477824:0@lo:101: 00000100:00100000:0.0:1790771973.099465:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771973.099523:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db9ed968 going to sleep for 11 seconds 00000100:00100000:2.0:1790771973.101324:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428477824 00000100:00100000:2.0:1790771973.101339:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428477824 00000100:00100000:2.0:1790771973.101405:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790771973.101413:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006df5ac05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:5820:x1877760428477824:12345-0@lo:101: 00010000:00010000:2.0:1790771973.101433:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771973.101454:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004625c93f/0xdf68d9a7d6a8fc44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fc3d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771973.101483:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004625c93f/0xdf68d9a7d6a8fc44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc3d expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771973.101508:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004625c93f/0xdf68d9a7d6a8fc44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc3d expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771973.101519:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004625c93f, rc 0) 00000100:00100000:2.0:1790771973.101631:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006df5ac05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5820:x1877760428477824:12345-0@lo:101: Request processed in 218us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771973.101638:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790771973.104224:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ace9901e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428477824:0@lo:101: 00010000:00010000:2.0:1790771973.104263:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 000000001bbaf0f8/0xdf68d9a7d6a8fc3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771973.104278:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 000000001bbaf0f8/0xdf68d9a7d6a8fc3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771973.104356:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044b2e3cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428477952:0@lo:256: 00000100:00100000:2.0:1790771973.104426:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771973.104470:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428477952 00000100:00100000:2.0:1790771973.104477:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428477952 00000100:00100000:2.0:1790771973.104538:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790771973.104567:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008097d275 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5820:x1877760428477952:12345-0@lo:256: 20000000:01000000:2.0:1790771973.104592:0:5818:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790771973.104624:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790771973.104628:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790771973.104731:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008097d275 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5820:x1877760428477952:12345-0@lo:256: Request processed in 186us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771973.104740:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790771973.107223:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007d32a52 going to sleep for 11 seconds 00000100:00100000:2.0:1790771973.107289:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044b2e3cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428477952:0@lo:256: 10000000:01000000:2.0:1790771973.107358:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790771973.107369:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 000000001bbaf0f8/0xdf68d9a7d6a8fc3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771973.107391:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 000000001bbaf0f8/0xdf68d9a7d6a8fc3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771973.155278:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790771973.566193:0:6100:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790771974.176199:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771975.204191:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771976.224084:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771977.249639:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771977.695850:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000486e7523 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428478208:0@lo:400: 00000100:00100000:2.0:1790771977.695895:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4fb8e9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428478080:0@lo:400: 00000100:00100000:2.0:1790771977.695984:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771977.696014:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771977.696117:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428478208 00000100:00100000:1.0:1790771977.696127:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428478208 00000100:00100000:1.0:1790771977.696175:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790771977.696183:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000753f1d01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428478208:12345-0@lo:400: 00000100:00100000:1.0:1790771977.696241:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000753f1d01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428478208:12345-0@lo:400: Request processed in 59us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771977.696248:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790771977.696290:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000486e7523 x1877760428478208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790771993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790771977.696304:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000486e7523 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428478208:0@lo:400: 00000100:00100000:3.0:1790771977.696364:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428478080 00000100:00100000:3.0:1790771977.696368:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428478080 00000100:00100000:3.0:1790771977.696401:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790771977.696406:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009feaabbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3296:x1877760428478080:12345-0@lo:400: 00000100:00100000:3.0:1790771977.696440:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009feaabbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3296:x1877760428478080:12345-0@lo:400: Request processed in 35us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771977.696446:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790771977.696500:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4fb8e9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428478080:0@lo:400: 00010000:00010000:2.0:1790771978.277799:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771979.295682:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790771979.296334:0:6302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbbe70710 20000000:00000080:2.0:1790771979.296446:0:6302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df27af15c00 uarg=0000000000000000 20000000:01000000:2.0:1790771979.296489:0:6302:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790771979.296497:0:6302:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790771979.296504:0:6302:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790771979.296827:0:6302:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1790771979.296842:0:6302:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1790771979.310878:0:6302:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790771979.311170:0:6302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790771979.311232:0:6302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1790771979.311305:0:6302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1790771979.311325:0:6302:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790771979.311346:0:6302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771979.312011:0:6302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a6186bf9/0xdf68d9a7d6a8fc0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc05 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771979.312021:0:6302:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771979.312082:0:6302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a6186bf9/0xdf68d9a7d6a8fc0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc05 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771979.312098:0:6302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a6186bf9/0xdf68d9a7d6a8fc0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc05 expref: 11 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771979.312118:0:6302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044b2e3cb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6302:1877760428478336:0@lo:104: 00000100:00100000:2.0:1790771979.318697:0:6302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771979.318774:0:6302:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006639eac going to sleep for 11 seconds 00000100:00100000:1.0:1790771979.318963:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428478336 00000100:00100000:1.0:1790771979.318974:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428478336 00000100:00100000:1.0:1790771979.319034:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790771979.319043:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000db1392e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:6302:x1877760428478336:12345-0@lo:104: 00010000:00010000:1.0:1790771979.319075:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771979.319146:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790771979.319152:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000db1392e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:6302:x1877760428478336:12345-0@lo:104: Request processed in 111us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771979.319159:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790771979.319184:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771979.319190:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771979.319198:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007473b492 already unused, calling callback (00000000efa3677f) 10000000:00010000:1.0:1790771979.319202:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771979.319211:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790771979.319218:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790771979.319224:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790771979.319264:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771979.319270:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790771979.319452:0:6302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044b2e3cb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6302:1877760428478336:0@lo:104: 00010000:00010000:0.0:1790771979.319482:0:6302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771979.319575:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771979.319592:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: 000000007473b492/0xdf68d9a7d6a8fc05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc0c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771979.319619:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771979.319620:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771979.319622:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771979.319637:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790771979.319651:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000486e7523 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428478464:0@lo:103: 00000100:00100000:1.0:1790771979.319685:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771979.319761:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428478464 00000100:00100000:0.0:1790771979.319766:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428478464 00010000:00010000:0.0:1790771979.319789:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a6186bf9/0xdf68d9a7d6a8fc0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc05 expref: 12 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771979.319822:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790771979.319829:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006873a75c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3293:x1877760428478464:12345-0@lo:103: 00010000:00010000:0.0:1790771979.319840:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771979.319845:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a6186bf9/0xdf68d9a7d6a8fc0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc05 expref: 12 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319867:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a6186bf9/0xdf68d9a7d6a8fc0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc05 expref: 12 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319881:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a6186bf9/0xdf68d9a7d6a8fc0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc05 expref: 12 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319895:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319903:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319918:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319924:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319942:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319947:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319953:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000084a76fd3 already unused, calling callback (00000000fb822f35) 00010000:00010000:0.0:1790771979.319957:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319963:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319977:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.319986:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771979.320020:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006873a75c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:3293:x1877760428478464:12345-0@lo:103: Request processed in 192us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771979.320027:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790771979.320058:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000486e7523 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428478464:0@lo:103: 00010000:00010000:0.0:1790771979.320076:0:6302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.320082:0:6302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771979.320087:0:6302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000084a76fd3/0xdf68d9a7d6a8fc4b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771980.319797:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790771981.279911:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790771981.279919:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df258965000 from 1 10000000:01000000:1.0:1790771981.279933:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790771981.279981:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 00000000a6186bf9/0xdf68d9a7d6a8fc52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771981.279994:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 00000000a6186bf9/0xdf68d9a7d6a8fc52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771981.280004:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 00000000a6186bf9/0xdf68d9a7d6a8fc52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771981.280028:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000020cd0deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428478592:0@lo:101: 00000100:00100000:1.0:1790771981.280103:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771981.280305:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428478592 00000100:00100000:3.0:1790771981.280321:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428478592 00000100:00100000:3.0:1790771981.280374:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790771981.280382:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006971061d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:5820:x1877760428478592:12345-0@lo:101: 00010000:00010000:3.0:1790771981.280396:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771981.280410:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016409ebe/0xdf68d9a7d6a8fc59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fc52 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771981.280433:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016409ebe/0xdf68d9a7d6a8fc59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc52 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771981.280442:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016409ebe/0xdf68d9a7d6a8fc59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc52 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771981.280450:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016409ebe, rc 0) 00000100:00100000:3.0:1790771981.280482:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006971061d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5820:x1877760428478592:12345-0@lo:101: Request processed in 101us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771981.280488:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790771981.280759:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039fa1505 going to sleep for 11 seconds 00000100:00100000:1.0:1790771981.280789:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000020cd0deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428478592:0@lo:101: 00010000:00010000:1.0:1790771981.280805:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 00000000a6186bf9/0xdf68d9a7d6a8fc52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771981.280812:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 00000000a6186bf9/0xdf68d9a7d6a8fc52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771981.281036:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000020cd0deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428478720:0@lo:501: 00000100:00100000:1.0:1790771981.281066:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771981.281130:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428478720 00000100:00100000:2.0:1790771981.281135:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428478720 00000100:00100000:2.0:1790771981.281171:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790771981.281177:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000098da2475 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5820:x1877760428478720:12345-0@lo:501: 00000100:00100000:2.0:1790771981.281421:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000098da2475 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5820:x1877760428478720:12345-0@lo:501: Request processed in 244us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771981.281428:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790771981.287758:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039fa1505 going to sleep for 11 seconds 00000100:00100000:1.0:1790771981.287931:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000020cd0deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428478720:0@lo:501: 00000100:00100000:1.0:1790771981.288001:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000020cd0deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428478848:0@lo:503: 00000100:00100000:1.0:1790771981.288089:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771981.288196:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039fa1505 going to sleep for 11 seconds 00000100:00100000:2.0:1790771981.295748:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428478848 00000100:00100000:2.0:1790771981.295761:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428478848 00000100:00100000:2.0:1790771981.295956:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790771981.295964:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001c7d751e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5820:x1877760428478848:12345-0@lo:503: 00000100:00100000:2.0:1790771981.296280:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001c7d751e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5820:x1877760428478848:12345-0@lo:503: Request processed in 315us (8190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771981.296288:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790771981.302732:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000020cd0deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428478848:0@lo:503: 00000100:00100000:0.0:1790771981.307192:0:6362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075090033 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6362:1877760428478976:0@lo:502: 00000100:00100000:0.0:1790771981.307286:0:6362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771981.307349:0:6362:0:(client.c:2716:ptlrpc_set_wait()) set 000000001538cbcd going to sleep for 11 seconds 00000100:00100000:3.0:1790771981.307414:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428478976 00000100:00100000:3.0:1790771981.307421:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428478976 00000100:00100000:3.0:1790771981.307459:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790771981.307466:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000055ae9670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6362:x1877760428478976:12345-0@lo:502: 00000100:00100000:3.0:1790771981.307706:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000055ae9670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6362:x1877760428478976:12345-0@lo:502: Request processed in 240us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771981.307714:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790771981.308048:0:6362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075090033 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6362:1877760428478976:0@lo:502: 00000020:01000000:0.0:1790771981.308078:0:6362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790771981.308089:0:6362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790771981.308092:0:6362:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790771981.308100:0:6362:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df258965000 00000020:00000080:0.0:1790771981.308103:0:6362:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790771981.308145:0:6362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6362:1877760428479104:0@lo:502: 00000100:00100000:0.0:1790771981.308182:0:6362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771981.308213:0:6362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790771981.308274:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428479104 00000100:00100000:1.0:1790771981.308281:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428479104 00000100:00100000:1.0:1790771981.308316:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790771981.308324:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6362:x1877760428479104:12345-0@lo:502: 00000100:00100000:1.0:1790771981.308458:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6362:x1877760428479104:12345-0@lo:502: Request processed in 134us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771981.308465:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790771981.308938:0:6362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6362:1877760428479104:0@lo:502: 00000020:01000000:0.0:1790771981.308960:0:6362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790771981.308966:0:6362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790771981.308968:0:6362:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790771981.308972:0:6362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790771981.309960:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790771981.309987:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790771981.309999:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204f600/0xdf68d9a7d6a8fc52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771981.310010:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df28204f600/0xdf68d9a7d6a8fc52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771981.343817:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771982.369116:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771982.824090:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428479360:0@lo:400: 00000100:00100000:0.0:1790771982.824179:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771982.824248:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790771982.824255:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428479232:0@lo:400: 00000100:00100000:0.0:1790771982.824285:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771982.824325:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428479232 00000100:00100000:0.0:1790771982.824335:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428479232 00000100:00100000:0.0:1790771982.824398:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790771982.824407:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3296:x1877760428479232:12345-0@lo:400: 00000100:00100000:0.0:1790771982.824466:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3296:x1877760428479232:12345-0@lo:400: Request processed in 60us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771982.824475:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790771982.824530:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428479232:0@lo:400: 00000100:00100000:2.0:1790771982.824714:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428479360 00000100:00100000:2.0:1790771982.824719:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428479360 00000100:00100000:2.0:1790771982.824751:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790771982.824758:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428479360:12345-0@lo:400: 00000100:00100000:2.0:1790771982.824808:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428479360:12345-0@lo:400: Request processed in 50us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771982.824815:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790771982.825015:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df27ab64700 x1877760428479360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790771998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790771982.825029:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428479360:0@lo:400: 00010000:00010000:0.0:1790771983.395934:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771984.419461:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771985.441883:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790771986.342300:0:6674:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790771986.342305:0:6674:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790771986.342431:0:6674:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df242cf1800 00000020:01000004:2.0:1790771986.342450:0:6674:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790771986.342464:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790771986.342481:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8df26fb199c0) 00000020:00000080:2.0:1790771986.342500:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790771986.372812:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790771986.373177:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1790771986.395481:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1790771986.402319:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790771986.402358:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1790771986.402435:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790771986.402465:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1790771986.403140:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790771986.403153:0:6674:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790771986.403166:0:6674:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdf68d9a7d6a8fc67 00000020:01000004:1.0:1790771986.403176:0:6674:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1790771986.403202:0:6674:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.127@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790771986.403206:0:6674:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790771986.403213:0:6674:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790771986.403218:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790771986.403230:0:6674:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8df258e03380) 00000020:00000080:1.0:1790771986.403248:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1790771986.406859:0:6674:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790771986.407059:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790771986.407066:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790771986.414404:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790771986.414417:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1790771986.415260:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1790771986.415271:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790771986.417349:0:6674:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790771986.418104:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790771986.418112:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1790771986.419235:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1790771986.419248:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790771986.442324:0:6674:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790771986.442755:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790771986.442763:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790771986.444203:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790771986.444219:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1790771986.446116:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790771986.446145:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1790771986.449197:0:6674:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790771986.449425:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1790771986.449432:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790771986.450388:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790771986.450398:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1790771986.467423:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790771986.499799:0:6674:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790771986.500102:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790771986.500110:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790771986.502304:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790771986.502319:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790771986.505747:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790771986.505789:0:6674:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790771986.505796:0:6674:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790771986.522371:0:6674:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790771986.522412:0:6674:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.127@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790771986.522417:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790771986.522419:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790771986.522421:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790771986.522422:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790771986.522424:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790771986.522425:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790771986.522427:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790771986.522429:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790771986.522430:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790771986.522432:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790771986.522434:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790771986.522439:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790771986.522445:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790771986.522446:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790771986.522447:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790771986.522448:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790771986.522449:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790771986.522450:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790771986.522451:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790771986.522452:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790771986.522453:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790771986.522454:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790771986.522454:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790771986.522487:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790771986.522800:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428479488:0@lo:253: 00000100:00100000:2.0:1790771986.522888:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771986.522952:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092300 going to sleep for 11 seconds 00000100:00100000:3.0:1790771986.523016:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428479488 00000100:00100000:3.0:1790771986.523028:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428479488 00000100:00100000:3.0:1790771986.523144:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790771986.523156:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428479488:12345-0@lo:253: 20000000:01000000:3.0:1790771986.523204:0:5816:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790771986.523208:0:5816:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790771986.523214:0:5816:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790771986.523218:0:5816:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790771986.524263:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790771986.524498:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1790771986.524513:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790771986.524600:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1790771986.524609:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790771986.524643:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1790771986.524695:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1790771986.525075:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1790771986.525096:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.127@tcp 20000000:01000000:3.0:1790771986.525098:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.127@tcp (null) (null) (null) 00000040:00080000:3.0:1790771986.525132:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1790771986.525140:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790771986.525185:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1790771986.525193:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.127@tcp (null) (null) 00000040:00080000:3.0:1790771986.525224:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1790771986.525234:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790771986.525264:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1790771986.525313:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1790771986.531126:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1790771986.531166:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.127@tcp 20000000:01000000:3.0:1790771986.531170:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.127@tcp (null) (null) (null) 00000040:00080000:3.0:1790771986.531227:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1790771986.531237:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790771986.531268:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1790771986.531276:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.127@tcp (null) (null) 00000040:00080000:3.0:1790771986.531320:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1790771986.531331:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790771986.531363:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1790771986.531399:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1790771986.531421:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790771986.531424:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790771986.531428:0:5816:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790771986.531444:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790771986.531447:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790771986.531486:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790771986.531489:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790771986.534257:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1790771986.534372:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1790771986.534425:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1790771986.535060:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1790771986.535113:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1790771986.535151:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1790771986.535165:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790771986.535168:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790771986.538636:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1790771986.539129:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1790771986.539186:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1790771986.539271:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1790771986.539289:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790771986.539304:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790771986.544498:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1790771986.544891:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1790771986.544966:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1790771986.545418:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1790771986.545473:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1790771986.547039:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1790771986.547096:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1790771986.547101:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1790771986.547114:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790771986.547141:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.547164:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8fb8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fb87 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.547171:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fbaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fba3 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.547177:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2414a3200/0xdf68d9a7d6a8fc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc13 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.547184:0:5816:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.547233:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2414a3200/0xdf68d9a7d6a8fc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc13 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.547252:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df2414a3200/0xdf68d9a7d6a8fc1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc13 expref: 12 pid: 5816 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771986.547266:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5816:1877760428479616:0@lo:104: 00000100:00100000:0.0:1790771986.547339:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771986.547413:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fbaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fba3 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.547439:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fbaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fba3 expref: 12 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771986.547447:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5816:1877760428479744:0@lo:104: 00000100:00100000:0.0:1790771986.547472:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771986.547642:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8fb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fb87 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.547650:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8fb8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fb87 expref: 12 pid: 5817 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771986.547658:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5816:1877760428479872:0@lo:104: 00000100:00100000:0.0:1790771986.547680:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771986.552454:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2437250c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771986.552502:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428479616 00000100:00100000:2.0:1790771986.552515:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428479616 00000100:00100000:2.0:1790771986.552612:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428479744 00000100:00100000:2.0:1790771986.552616:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428479744 00000100:00100000:2.0:1790771986.552628:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428479872 00000100:00100000:2.0:1790771986.552631:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428479872 00000100:00100000:2.0:1790771986.552650:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790771986.552659:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:5816:x1877760428479616:12345-0@lo:104: 00010000:00010000:2.0:1790771986.552680:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a8fc13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.552987:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790771986.552994:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:5816:x1877760428479616:12345-0@lo:104: Request processed in 336us (5655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771986.553002:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790771986.553038:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790771986.553046:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:5816:x1877760428479744:12345-0@lo:104: 00010000:00010000:2.0:1790771986.553054:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df240031c00/0xdf68d9a7d6a8fba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553094:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790771986.553099:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:5816:x1877760428479744:12345-0@lo:104: Request processed in 55us (5627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771986.553105:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790771986.553116:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790771986.553122:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:5816:x1877760428479872:12345-0@lo:104: 00010000:00010000:2.0:1790771986.553129:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553159:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790771986.553164:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:5816:x1877760428479872:12345-0@lo:104: Request processed in 43us (5483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771986.553169:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790771986.553189:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790771986.553196:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a8fc13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553203:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790771986.553207:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a8fc13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553216:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a8fc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790771986.553234:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a8fc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790771986.553241:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790771986.553283:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a8fc13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553290:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790771986.553306:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a8fc13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553313:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a8fc13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553326:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790771986.553329:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df240031c00/0xdf68d9a7d6a8fba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553334:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031c00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790771986.553337:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df240031c00/0xdf68d9a7d6a8fba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553343:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df240031c00/0xdf68d9a7d6a8fba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790771986.553348:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df240031c00/0xdf68d9a7d6a8fba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790771986.553353:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790771986.553373:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df240031c00/0xdf68d9a7d6a8fba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553379:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790771986.553384:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df240031c00/0xdf68d9a7d6a8fba3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553390:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df240031c00/0xdf68d9a7d6a8fba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fbaa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553400:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771986.553402:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553407:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790771986.553409:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553415:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790771986.553421:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790771986.553426:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790771986.553437:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fb87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553442:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790771986.553456:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fb87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553476:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fb87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fb8e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.553493:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771986.553495:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771986.553496:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790771986.553523:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428480256:0@lo:103: 00000100:00100000:2.0:1790771986.553682:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771986.553859:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771986.553873:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428480000:0@lo:103: 00000100:00100000:0.0:1790771986.553902:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.553932:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790771986.553938:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428480128:0@lo:103: 00000100:00100000:0.0:1790771986.553956:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.553991:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428480256 00000100:00100000:0.0:1790771986.553996:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428480256 00010000:00010000:0.0:1790771986.554043:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8fb8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fb87 expref: 13 pid: 5817 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771986.554062:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428480000 00000100:00100000:0.0:1790771986.554066:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428480000 00010000:00010000:0.0:1790771986.554076:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2414a3200/0xdf68d9a7d6a8fc1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc13 expref: 14 pid: 5816 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771986.554100:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428480128 00000100:00100000:0.0:1790771986.554102:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428480128 00010000:00010000:0.0:1790771986.554113:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fbaa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fba3 expref: 15 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771986.554125:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790771986.554132:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:3295:x1877760428480256:12345-0@lo:103: 00010000:00010000:0.0:1790771986.554144:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771986.554149:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8fb8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fb87 expref: 15 pid: 5817 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554160:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8fb8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fb87 expref: 15 pid: 5817 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554179:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771986.554213:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:3295:x1877760428480256:12345-0@lo:103: Request processed in 81us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771986.554219:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790771986.554236:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790771986.554241:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:3293:x1877760428480000:12345-0@lo:103: 00010000:00010000:0.0:1790771986.554248:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771986.554253:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2414a3200/0xdf68d9a7d6a8fc1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc13 expref: 14 pid: 5816 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554262:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2414a3200/0xdf68d9a7d6a8fc1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc13 expref: 14 pid: 5816 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554271:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771986.554305:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:3293:x1877760428480000:12345-0@lo:103: Request processed in 63us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771986.554311:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790771986.554323:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790771986.554329:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:3293:x1877760428480128:12345-0@lo:103: 00010000:00010000:0.0:1790771986.554336:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771986.554341:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fbaa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fba3 expref: 13 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554349:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fbaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fba3 expref: 13 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554362:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554372:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554388:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554396:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554404:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554411:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554416:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790771986.554428:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554437:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554446:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.554456:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771986.554481:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:3293:x1877760428480128:12345-0@lo:103: Request processed in 152us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771986.554488:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790771986.554531:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428480128:0@lo:103: 00000100:00100000:0.0:1790771986.554584:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428480000:0@lo:103: 00000100:00100000:0.0:1790771986.554869:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428480256:0@lo:103: 00010000:00010000:1.0:1790771986.555185:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a3200/0xdf68d9a7d6a8fc1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc13 expref: 12 pid: 5816 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771986.555200:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5816:1877760428479616:0@lo:104: 00010000:00010000:1.0:1790771986.555225:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fbaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fba3 expref: 11 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771986.555236:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5816:1877760428479744:0@lo:104: 00010000:00010000:1.0:1790771986.555246:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8fb8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fb87 expref: 10 pid: 5817 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771986.555256:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5816:1877760428479872:0@lo:104: 00010000:00010000:1.0:1790771986.555275:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.555285:0:5816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.555291:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.555297:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fc75 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790771986.555313:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790771986.625098:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:6674:x1877760428479488:12345-0@lo:253: Request processed in 101933us (102198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771986.625116:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790771986.625233:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428479488:0@lo:253: 10000000:01000000:2.0:1790771986.625251:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790771986.625254:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790771986.625256:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790771986.625257:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790771986.625259:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1790771986.625260:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790771986.625261:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790771986.625262:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790771986.625264:0:6674:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790771986.625266:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790771986.625267:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790771986.625288:0:6674:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df242cf1800 from lustre-OST0000 10000000:01000000:2.0:1790771986.625315:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790771986.625317:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790771986.625324:0:6674:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df258e04d40 local copy 10000000:01000000:2.0:1790771986.625328:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790771986.625368:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.625380:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.625408:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771986.625428:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428480384:0@lo:101: 00000100:00100000:2.0:1790771986.625469:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771986.625532:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092600 going to sleep for 11 seconds 00000100:00100000:0.0:1790771986.625764:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428480384 00000100:00100000:0.0:1790771986.625772:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428480384 00000100:00100000:0.0:1790771986.625817:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790771986.625827:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:6674:x1877760428480384:12345-0@lo:101: 00010000:00010000:0.0:1790771986.625843:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771986.625859:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fc83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fc7c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.625887:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc7c expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.625909:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fc83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc7c expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.625920:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031600, rc 0) 00000100:00100000:0.0:1790771986.625971:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+10:6674:x1877760428480384:12345-0@lo:101: Request processed in 145us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771986.625978:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790771986.626104:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428480384:0@lo:101: 00010000:00010000:2.0:1790771986.626119:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.626128:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771986.626233:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428480512:0@lo:501: 00000100:00100000:2.0:1790771986.626259:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771986.626287:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092600 going to sleep for 11 seconds 00000100:00100000:0.0:1790771986.626715:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428480512 00000100:00100000:0.0:1790771986.626722:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428480512 00000100:00100000:0.0:1790771986.626764:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790771986.626772:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+10:6674:x1877760428480512:12345-0@lo:501: 00000100:00100000:0.0:1790771986.627096:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+10:6674:x1877760428480512:12345-0@lo:501: Request processed in 324us (836us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790771986.627104:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790771986.631615:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428480512:0@lo:501: 10000000:01000000:3.0:1790771986.631656:0:6674:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790771986.631729:0:6674:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790771986.631741:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.631754:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.631762:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.631803:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790771986.631836:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df242cf1800 10000000:01000000:3.0:1790771986.631841:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790771986.631847:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8df258e04d40 10000000:01000000:3.0:1790771986.631849:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790771986.631852:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8df258e04d40 from 1 10000000:01000000:3.0:1790771986.631855:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790771986.631895:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a3800/0xdf68d9a7d6a8fc8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.631903:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df2414a3800/0xdf68d9a7d6a8fc8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.631916:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df2414a3800/0xdf68d9a7d6a8fc8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771986.631936:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428480640:0@lo:101: 00000100:00100000:3.0:1790771986.632004:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771986.632056:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26a216180 going to sleep for 11 seconds 00010000:00010000:2.0:1790771986.632215:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771986.632225:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.632233:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790771986.632237:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.632246:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790771986.632253:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790771986.632270:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790771986.632296:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.632302:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790771986.632332:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.632339:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fc7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf68d9a7d6a8fc83 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.632358:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771986.632360:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771986.632362:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771986.632424:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428480640 00000100:00100000:1.0:1790771986.632432:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428480640 00000100:00100000:1.0:1790771986.632491:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790771986.632502:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+10:6674:x1877760428480640:12345-0@lo:101: 00010000:00010000:1.0:1790771986.632517:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771986.632532:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fc91 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fc8a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.632605:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fc91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc8a expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.632626:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fc91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc8a expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.632635:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df28204ec00, rc 0) 00000100:00100000:1.0:1790771986.632686:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428480640:12345-0@lo:101: Request processed in 187us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.632693:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790771986.633060:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790771986.633075:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428480768:0@lo:103: 00000100:00100000:3.0:1790771986.633112:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771986.633657:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428480640:0@lo:101: 00010000:00010000:3.0:1790771986.633679:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df2414a3800/0xdf68d9a7d6a8fc8a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc91 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.633691:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df2414a3800/0xdf68d9a7d6a8fc8a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fc91 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790771986.633728:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790771986.633752:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a3800/0xdf68d9a7d6a8fc8a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc91 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.633761:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df2414a3800/0xdf68d9a7d6a8fc8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc91 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790771986.633770:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790771986.633775:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790771986.633780:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790771986.633783:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790771986.633810:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.633818:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.633827:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771986.633842:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428480896:0@lo:101: 00000100:00100000:3.0:1790771986.633874:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771986.633893:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26a216180 going to sleep for 11 seconds 00000100:00100000:3.0:1790771986.636468:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428480896 00000100:00100000:3.0:1790771986.636486:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428480896 00000100:00100000:2.0:1790771986.636639:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428480768 00000100:00100000:2.0:1790771986.636644:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428480768 00000100:00100000:2.0:1790771986.636696:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790771986.636706:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3295:x1877760428480768:12345-0@lo:103: 00010000:00010000:2.0:1790771986.636724:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771986.636746:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fc83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc7c expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.636768:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771986.637800:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790771986.637830:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428480896:12345-0@lo:101: 00010000:00010000:3.0:1790771986.637848:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771986.637880:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2414a3c00/0xdf68d9a7d6a8fc9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fc98 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.637908:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2414a3c00/0xdf68d9a7d6a8fc9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc98 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.637920:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2414a3c00/0xdf68d9a7d6a8fc9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc98 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.637927:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3c00, rc 0) 00000100:00100000:3.0:1790771986.638004:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428480896:12345-0@lo:101: Request processed in 193us (4129us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771986.638012:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790771986.638107:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:3295:x1877760428480768:12345-0@lo:103: Request processed in 1401us (4992us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771986.638114:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790771986.638165:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428480768:0@lo:103: 00000100:00100000:0.0:1790771986.638948:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428480896:0@lo:101: 00010000:00010000:0.0:1790771986.638974:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.638986:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771986.639117:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481024:0@lo:501: 00000100:00100000:0.0:1790771986.639170:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.640049:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df250bb0780 going to sleep for 11 seconds 00000100:00100000:1.0:1790771986.640134:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428481024 00000100:00100000:1.0:1790771986.640144:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428481024 00000100:00100000:1.0:1790771986.640193:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790771986.640202:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428481024:12345-0@lo:501: 00000100:00100000:1.0:1790771986.641030:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428481024:12345-0@lo:501: Request processed in 824us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.641042:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790771986.641269:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481024:0@lo:501: 00000100:00100000:0.0:1790771986.641321:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481152:0@lo:503: 00000100:00100000:0.0:1790771986.641381:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.641518:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df250bb0780 going to sleep for 11 seconds 00000100:00100000:2.0:1790771986.646161:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428481152 00000100:00100000:2.0:1790771986.646201:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428481152 00000100:00100000:1.0:1790771986.646524:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790771986.646562:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428481152:12345-0@lo:503: 00000100:00100000:1.0:1790771986.646977:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428481152:12345-0@lo:503: Request processed in 441us (5594us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.646986:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790771986.647113:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481152:0@lo:503: 00000040:00080000:0.0:1790771986.647472:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790771986.647614:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481280:0@lo:502: 00000100:00100000:0.0:1790771986.647670:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.647706:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df250bb0780 going to sleep for 11 seconds 00000100:00100000:1.0:1790771986.648011:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428481280 00000100:00100000:1.0:1790771986.648018:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428481280 00000100:00100000:1.0:1790771986.648065:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790771986.648074:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428481280:12345-0@lo:502: 00000100:00100000:1.0:1790771986.648253:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428481280:12345-0@lo:502: Request processed in 179us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.648260:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790771986.648430:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481280:0@lo:502: 00000040:00080000:0.0:1790771986.648918:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790771986.648969:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790771986.649001:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790771986.649047:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790771986.649086:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790771986.649123:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790771986.649158:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481408:0@lo:502: 00000100:00100000:0.0:1790771986.649207:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.649234:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df250bb0780 going to sleep for 11 seconds 00000100:00100000:0.0:1790771986.649258:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428481408 00000100:00100000:0.0:1790771986.649264:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428481408 00000100:00100000:0.0:1790771986.649291:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790771986.649298:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428481408:12345-0@lo:502: 00000100:00100000:0.0:1790771986.651234:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428481408:12345-0@lo:502: Request processed in 1925us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771986.651249:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790771986.651347:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481408:0@lo:502: 00000040:00080000:2.0:1790771986.652047:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790771986.652070:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1790771986.653089:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790771986.653100:0:6693:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1790771986.653108:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790771986.653111:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790771986.653117:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790771986.653141:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8df27fad19c0) 00000020:00000080:2.0:1790771986.653167:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790771986.653174:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790771986.653248:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df242cf1800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790771986.653256:0:6693:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790771986.653263:0:6693:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdf68d9a7d6a8fcad 00010000:00010000:3.0:1790771986.658068:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1790771986.658420:0:6693:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1790771986.663465:0:6693:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790771986.664049:0:6693:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1790771986.672369:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790771986.673840:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790771986.675341:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790771986.675355:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790771986.675362:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790771986.675369:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790771986.675374:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790771986.675378:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790771986.675379:0:6693:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790771986.675382:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790771986.675384:0:6693:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790771986.675441:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790771986.675444:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790771986.675446:0:6693:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790771986.675449:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790771986.677734:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1790771986.677777:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790771986.677802:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.677828:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790771986.677838:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df242cf1800 from 1 10000000:01000000:2.0:1790771986.677841:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790771986.677886:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.677894:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.677907:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771986.677942:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481536:0@lo:101: 00000100:00100000:2.0:1790771986.678020:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771986.678073:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092000 going to sleep for 11 seconds 00000100:00100000:2.0:1790771986.678315:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428481536 00000100:00100000:2.0:1790771986.678325:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428481536 00000100:00100000:2.0:1790771986.678375:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790771986.678385:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:6674:x1877760428481536:12345-0@lo:101: 00010000:00010000:2.0:1790771986.678401:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771986.678415:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241390800/0xdf68d9a7d6a8fcbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fcb4 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.678443:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241390800/0xdf68d9a7d6a8fcbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcb4 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.678455:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241390800/0xdf68d9a7d6a8fcbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcb4 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.678465:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241390800, rc 0) 00000100:00100000:2.0:1790771986.678509:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428481536:12345-0@lo:101: Request processed in 125us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771986.678517:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790771986.678749:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481536:0@lo:101: 00010000:00010000:2.0:1790771986.678770:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771986.678780:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771986.678977:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481664:0@lo:501: 00000100:00100000:2.0:1790771986.679009:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771986.682768:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092000 going to sleep for 11 seconds 00000100:00100000:1.0:1790771986.684393:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428481664 00000100:00100000:1.0:1790771986.684408:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428481664 00000100:00100000:1.0:1790771986.684473:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790771986.684486:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428481664:12345-0@lo:501: 00000100:00100000:1.0:1790771986.686150:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428481664:12345-0@lo:501: Request processed in 1660us (7131us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.686164:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790771986.686277:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481664:0@lo:501: 00000100:00100000:2.0:1790771986.686331:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481792:0@lo:503: 00000100:00100000:2.0:1790771986.686382:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771986.686457:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092000 going to sleep for 11 seconds 00000100:00100000:0.0:1790771986.686492:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428481792 00000100:00100000:0.0:1790771986.686500:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428481792 00000100:00100000:0.0:1790771986.686897:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790771986.686908:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428481792:12345-0@lo:503: 00000100:00100000:0.0:1790771986.687375:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428481792:12345-0@lo:503: Request processed in 467us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771986.687383:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790771986.687458:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481792:0@lo:503: 00000040:00080000:3.0:1790771986.688165:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790771986.688245:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481920:0@lo:502: 00000100:00100000:3.0:1790771986.688300:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771986.688390:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df245aad840 going to sleep for 11 seconds 00000100:00100000:0.0:1790771986.688448:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428481920 00000100:00100000:0.0:1790771986.688455:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428481920 00000100:00100000:0.0:1790771986.688533:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790771986.688574:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428481920:12345-0@lo:502: 00000100:00100000:0.0:1790771986.689110:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428481920:12345-0@lo:502: Request processed in 537us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771986.689121:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790771986.689259:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428481920:0@lo:502: 00000040:00080000:3.0:1790771986.689773:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790771986.690080:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790771986.690122:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482048:0@lo:502: 00000100:00100000:3.0:1790771986.690185:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771986.690255:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df245aad840 going to sleep for 11 seconds 00000100:00100000:1.0:1790771986.690330:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428482048 00000100:00100000:1.0:1790771986.690338:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428482048 00000100:00100000:1.0:1790771986.690390:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790771986.690401:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428482048:12345-0@lo:502: 00000100:00100000:1.0:1790771986.690703:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428482048:12345-0@lo:502: Request processed in 305us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.690712:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790771986.690848:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482048:0@lo:502: 00000040:00080000:3.0:1790771986.690986:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790771986.690999:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790771986.692166:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790771986.692181:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790771986.692183:0:6697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790771986.692191:0:6697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df242cf1800 00000020:00000080:3.0:1790771986.692193:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790771986.692210:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790771986.692213:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790771986.692214:0:6697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790771986.692217:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790771986.692340:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790771986.692362:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790771986.692385:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.692398:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790771986.692453:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790771986.692456:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df242cf1800 10000000:01000000:0.0:1790771986.692459:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df242cf1800 10000000:01000000:0.0:1790771986.692463:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790771986.692468:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df242cf1800 from 1 10000000:01000000:0.0:1790771986.692470:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790771986.692505:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.692513:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.692524:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771986.692884:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482176:0@lo:101: 00000100:00100000:0.0:1790771986.692957:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.692990:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790771986.693049:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428482176 00000100:00100000:1.0:1790771986.693057:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428482176 00000100:00100000:1.0:1790771986.693109:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790771986.693120:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428482176:12345-0@lo:101: 00010000:00010000:1.0:1790771986.693137:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771986.693152:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df28204f200/0xdf68d9a7d6a8fcc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fcc2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.693179:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df28204f200/0xdf68d9a7d6a8fcc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcc2 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.693191:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df28204f200/0xdf68d9a7d6a8fcc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcc2 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.693200:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df28204f200, rc 0) 00000100:00100000:1.0:1790771986.693274:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6674:x1877760428482176:12345-0@lo:101: Request processed in 155us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.693281:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790771986.693404:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482176:0@lo:101: 00010000:00010000:0.0:1790771986.693420:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.693429:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771986.693531:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482304:0@lo:501: 00000100:00100000:0.0:1790771986.693766:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.693795:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790771986.693919:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428482304 00000100:00100000:1.0:1790771986.693925:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428482304 00000100:00100000:1.0:1790771986.693996:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790771986.694006:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6674:x1877760428482304:12345-0@lo:501: 00000100:00100000:1.0:1790771986.694270:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6674:x1877760428482304:12345-0@lo:501: Request processed in 265us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.694277:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790771986.694346:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482304:0@lo:501: 00000100:00100000:0.0:1790771986.694380:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482432:0@lo:503: 00000100:00100000:0.0:1790771986.695137:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.695482:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790771986.695514:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428482432 00000100:00100000:3.0:1790771986.695522:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428482432 00000100:00100000:3.0:1790771986.695900:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790771986.695911:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6674:x1877760428482432:12345-0@lo:503: 00000100:00100000:3.0:1790771986.696196:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6674:x1877760428482432:12345-0@lo:503: Request processed in 287us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771986.696204:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790771986.696277:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482432:0@lo:503: 00000040:00080000:0.0:1790771986.696805:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790771986.696951:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482560:0@lo:502: 00000100:00100000:0.0:1790771986.696998:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.697177:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790771986.697234:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428482560 00000100:00100000:1.0:1790771986.697241:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428482560 00000100:00100000:1.0:1790771986.697274:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790771986.697282:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6674:x1877760428482560:12345-0@lo:502: 00000100:00100000:1.0:1790771986.697483:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6674:x1877760428482560:12345-0@lo:502: Request processed in 202us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.697490:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790771986.697795:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482560:0@lo:502: 00000040:00080000:0.0:1790771986.698180:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790771986.698241:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790771986.698276:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790771986.698334:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790771986.698371:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790771986.698425:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790771986.698461:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790771986.698488:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790771986.698529:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790771986.698952:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790771986.698992:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790771986.699063:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790771986.699102:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790771986.699137:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790771986.699185:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790771986.699222:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790771986.699257:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790771986.699321:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790771986.699368:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790771986.699405:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790771986.699455:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790771986.699493:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790771986.699529:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790771986.702376:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790771986.702423:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790771986.702450:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790771986.702487:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790771986.704726:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1790771986.705121:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482688:0@lo:502: 00000100:00100000:0.0:1790771986.705223:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.705263:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790771986.705346:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428482688 00000100:00100000:1.0:1790771986.705357:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428482688 00000100:00100000:1.0:1790771986.705424:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790771986.705434:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6674:x1877760428482688:12345-0@lo:502: 00000100:00100000:1.0:1790771986.705948:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6674:x1877760428482688:12345-0@lo:502: Request processed in 514us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.705957:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790771986.706057:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428482688:0@lo:502: 00000040:00080000:0.0:1790771986.706173:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790771986.706187:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1790771986.707029:0:6698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790771986.707048:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8df2581cb380) 00000020:00000080:0.0:1790771986.707072:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1790771986.707146:0:6698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df242cf1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790771986.707151:0:6698:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df242cf1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790771986.707154:0:6698:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df242cf1800 3 00010000:00080000:0.0:1790771986.707205:0:6698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df26f67a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.127@tcp at head 00010000:00010000:0.0:1790771986.709927:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1790771986.710161:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790771986.710204:0:6698:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790771986.710231:0:6698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdf68d9a7d6a8fcd7 00000100:00080000:0.0:1790771986.710244:0:6698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790771986.710257:0:6698:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df26f67a000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1790771986.710301:0:6698:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df26fad6d80 x1877760428482816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790771986.710392:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1877760428482816:0@lo:38: 00000100:00100000:1.0:1790771986.710470:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790771986.713709:0:6698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790771986.713886:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428482944:0@lo:400: 00000100:00100000:0.0:1790771986.714227:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771986.714382:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428482816 00000100:00100000:2.0:1790771986.714393:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428482816 00000100:00100000:2.0:1790771986.714436:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428482944 00000100:00100000:2.0:1790771986.714440:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428482944 00000100:00100000:2.0:1790771986.714471:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790771986.714481:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428482944:12345-0@lo:400: 00000100:00100000:0.0:1790771986.714697:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790771986.714706:0:5824:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790771986.714778:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428482944:12345-0@lo:400: Request processed in 297us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771986.714787:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790771986.714810:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790771986.714943:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1877760428482816:12345-0@lo:38: 00010000:00080000:2.0:1790771986.714971:0:5823:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:2.0:1790771986.715005:0:5823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdf68d9a7d6a8fcde 00000004:00100000:2.0:1790771986.715021:0:5823:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790771986.715055:0:5823:0:(import.c:65:import_set_state_nolock()) ffff8df248b95800 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1790771986.715661:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1790771986.721746:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1790771986.721798:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1790771986.721962:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877760428482816:12345-0@lo:38: Request processed in 7137us (11484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771986.721977:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790771986.722077:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df26fad5880 x1877760428482944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790771986.722095:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428482944:0@lo:400: 00010000:00010000:0.0:1790771986.722188:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771986.722200:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790771986.722259:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790771986.722261:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790771986.722263:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790771986.722264:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790771986.722265:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790771986.722267:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790771986.722269:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790771986.722271:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790771986.722272:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790771986.722274:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790771986.722276:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790771986.722280:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1790771986.722283:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790771986.722284:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790771986.722285:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790771986.722286:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790771986.722287:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790771986.722289:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790771986.722289:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790771986.722295:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790771986.722296:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790771986.722297:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790771986.722298:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790771986.722331:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790771986.722349:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428483072:0@lo:253: 00000100:00100000:0.0:1790771986.722420:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771986.722717:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df14130c240 going to sleep for 11 seconds 00010000:00080000:1.0:1790771986.722858:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df26fad6d80 x1877760428482816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790771996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790771986.722877:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790771986.722887:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1790771986.722897:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790771986.722903:0:3292:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790771986.722907:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df26f67a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790771986.722915:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1877760428482816:0@lo:38: 00000100:00100000:2.0:1790771986.723118:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428483072 00000100:00100000:2.0:1790771986.723127:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428483072 00000100:00100000:2.0:1790771986.723182:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790771986.723192:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6674:x1877760428483072:12345-0@lo:253: 20000000:01000000:2.0:1790771986.723227:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790771986.723246:0:5817:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790771986.746440:0:5817:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790771986.746491:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1790771986.748527:0:5839:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790771986.748565:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790771986.748718:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.748744:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fc44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc3d expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.748754:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.748974:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fc44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc3d expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771986.748991:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fc44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc3d expref: 13 pid: 5817 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771986.749007:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5839:1877760428483200:0@lo:104: 00000100:00100000:3.0:1790771986.749079:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771986.749166:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df245aad840 going to sleep for 11 seconds 00000100:00100000:1.0:1790771986.749268:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428483200 00000100:00100000:1.0:1790771986.749277:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428483200 00000100:00100000:1.0:1790771986.749331:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790771986.749341:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:5839:x1877760428483200:12345-0@lo:104: 00010000:00010000:1.0:1790771986.749357:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df240030c00/0xdf68d9a7d6a8fc3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.749428:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790771986.749435:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:5839:x1877760428483200:12345-0@lo:104: Request processed in 95us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.749442:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1790771986.749475:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771986.749482:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df240030c00/0xdf68d9a7d6a8fc3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.749489:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030c00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790771986.749494:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df240030c00/0xdf68d9a7d6a8fc3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.749503:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df240030c00/0xdf68d9a7d6a8fc3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790771986.749510:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df240030c00/0xdf68d9a7d6a8fc3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790771986.749517:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790771986.749580:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df240030c00/0xdf68d9a7d6a8fc3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.749587:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790771986.749725:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5839:1877760428483200:0@lo:104: 00010000:00010000:0.0:1790771986.749750:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.749891:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df240030c00/0xdf68d9a7d6a8fc3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.749899:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df240030c00/0xdf68d9a7d6a8fc3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc44 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.749918:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771986.749920:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771986.749922:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771986.749938:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790771986.749950:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428483328:0@lo:103: 00000100:00100000:1.0:1790771986.749989:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771986.750036:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428483328 00000100:00100000:1.0:1790771986.750041:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428483328 00010000:00010000:1.0:1790771986.750060:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fc44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc3d expref: 14 pid: 5817 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771986.750083:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790771986.750089:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:3293:x1877760428483328:12345-0@lo:103: 00010000:00010000:1.0:1790771986.750101:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771986.750105:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fc44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc3d expref: 14 pid: 5817 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750115:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fc44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc3d expref: 14 pid: 5817 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750129:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fc44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc3d expref: 14 pid: 5817 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750143:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750152:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790771986.750166:0:5809:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003591187s 00010000:00010000:1.0:1790771986.750171:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750179:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750186:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750203:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750209:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df28204f000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790771986.750214:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750223:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750236:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750245:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771986.750273:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:3293:x1877760428483328:12345-0@lo:103: Request processed in 184us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771986.750280:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790771986.750333:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428483328:0@lo:103: 00010000:00010000:1.0:1790771986.750347:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750354:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771986.750360:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fce5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771986.757469:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:6674:x1877760428483072:12345-0@lo:253: Request processed in 34262us (35032us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771986.757490:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790771986.757804:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6674:1877760428483072:0@lo:253: 10000000:01000000:1.0:1790771986.757896:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790771986.757915:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790771986.757917:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790771986.757919:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790771986.757920:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790771986.757922:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790771986.757923:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790771986.757925:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790771986.757927:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790771986.757928:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790771986.757931:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790771986.757932:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790771986.757949:0:6674:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790771986.763298:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790771986.763484:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790771986.763922:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790771986.764108:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790771986.764512:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790771986.764975:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790771986.766160:0:6674:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1790771987.063616:0:6674:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790771987.063625:0:6674:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790771987.063671:0:6674:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790771987.063737:0:6674:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790771987.063757:0:6674:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790771987.063785:0:6674:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790771987.490061:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771988.512758:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790771988.768340:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790771988.768348:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df258965000 from 21 10000000:01000000:2.0:1790771988.768353:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790771988.768409:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771988.768421:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771988.768433:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771988.768458:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428483456:0@lo:101: 00000100:00100000:2.0:1790771988.768545:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771988.768626:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092600 going to sleep for 11 seconds 00000100:00100000:0.0:1790771988.769125:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428483456 00000100:00100000:0.0:1790771988.769135:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428483456 00000100:00100000:0.0:1790771988.769200:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790771988.769211:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5820:x1877760428483456:12345-0@lo:101: 00010000:00010000:0.0:1790771988.769229:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771988.769246:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fcf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fcec expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771988.769286:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fcf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcec expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771988.769299:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fcf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcec expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771988.769309:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031200, rc 0) 00000100:00100000:0.0:1790771988.769376:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428483456:12345-0@lo:101: Request processed in 166us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771988.769383:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790771988.773105:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428483456:0@lo:101: 00010000:00010000:3.0:1790771988.773146:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771988.773162:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771988.773261:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428483584:0@lo:501: 00000100:00100000:3.0:1790771988.773328:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771988.773390:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f78b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790771988.773857:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428483584 00000100:00100000:0.0:1790771988.773866:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428483584 00000100:00100000:0.0:1790771988.773916:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790771988.773926:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428483584:12345-0@lo:501: 00000100:00100000:0.0:1790771988.774345:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428483584:12345-0@lo:501: Request processed in 418us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771988.774354:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790771988.774598:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428483584:0@lo:501: 00000100:00100000:2.0:1790771988.774648:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428483712:0@lo:503: 00000100:00100000:2.0:1790771988.774698:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771988.774744:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790771988.774975:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428483712 00000100:00100000:0.0:1790771988.774982:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428483712 00000100:00100000:0.0:1790771988.775024:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790771988.775033:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428483712:12345-0@lo:503: 00000100:00100000:0.0:1790771988.775356:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428483712:12345-0@lo:503: Request processed in 323us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771988.775364:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790771988.778199:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428483712:0@lo:503: 00000100:00100000:2.0:1790771988.783760:0:6774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6774:1877760428483840:0@lo:502: 00000100:00100000:2.0:1790771988.783861:0:6774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771988.783915:0:6774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092600 going to sleep for 11 seconds 00000100:00100000:1.0:1790771988.784014:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428483840 00000100:00100000:1.0:1790771988.784024:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428483840 00000100:00100000:1.0:1790771988.784086:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790771988.784097:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6774:x1877760428483840:12345-0@lo:502: 00000100:00100000:1.0:1790771988.784452:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6774:x1877760428483840:12345-0@lo:502: Request processed in 357us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771988.784461:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790771988.784661:0:6774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6774:1877760428483840:0@lo:502: 00000100:00100000:2.0:1790771988.784715:0:6774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6774:1877760428483968:0@lo:502: 00000100:00100000:2.0:1790771988.784752:0:6774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771988.784779:0:6774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092600 going to sleep for 11 seconds 00000100:00100000:1.0:1790771988.784856:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428483968 00000100:00100000:1.0:1790771988.784861:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428483968 00000100:00100000:1.0:1790771988.784885:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790771988.784893:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6774:x1877760428483968:12345-0@lo:502: 00000100:00100000:1.0:1790771988.785033:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:6774:x1877760428483968:12345-0@lo:502: Request processed in 141us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771988.785041:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790771988.785130:0:6774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6774:1877760428483968:0@lo:502: 00000040:00080000:2.0:1790771988.785149:0:6774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1790771988.785464:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1790771988.785490:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790771988.785502:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.785515:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790771988.785525:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790771988.785539:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df258965000 from 4 10000000:01000000:1.0:1790771988.785543:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790771988.785666:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.785675:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.785685:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771988.785701:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428484096:0@lo:101: 00000100:00100000:1.0:1790771988.785735:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771988.788997:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f8db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771988.793300:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428484096 00000100:00100000:2.0:1790771988.793322:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428484096 00000100:00100000:2.0:1790771988.793480:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790771988.793494:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428484096:12345-0@lo:101: 00010000:00010000:2.0:1790771988.793517:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771988.793643:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241391c00/0xdf68d9a7d6a8fd01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fcfa expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771988.793679:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241391c00/0xdf68d9a7d6a8fd01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcfa expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771988.793691:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241391c00/0xdf68d9a7d6a8fd01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcfa expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771988.793701:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241391c00, rc 0) 00000100:00100000:2.0:1790771988.793973:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428484096:12345-0@lo:101: Request processed in 311us (8065us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771988.793993:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790771988.794250:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428484096:0@lo:101: 00010000:00010000:1.0:1790771988.794271:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.794284:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771988.794355:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428484224:0@lo:256: 00000100:00100000:1.0:1790771988.794400:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771988.794436:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f8db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771988.794641:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428484224 00000100:00100000:2.0:1790771988.794648:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428484224 00000100:00100000:2.0:1790771988.794825:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790771988.794837:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428484224:12345-0@lo:256: 20000000:01000000:2.0:1790771988.794858:0:5817:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790771988.794879:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790771988.794883:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1790771988.794990:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428484224:12345-0@lo:256: Request processed in 156us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771988.794998:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790771988.795059:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428484224:0@lo:256: 10000000:01000000:1.0:1790771988.795108:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790771988.795116:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.795125:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790771988.795133:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790771988.795136:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1790771988.795139:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790771988.795163:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.795170:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.795180:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771988.795193:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428484352:0@lo:101: 00000100:00100000:1.0:1790771988.795218:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771988.795484:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25089af00 going to sleep for 11 seconds 00000100:00100000:3.0:1790771988.795576:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428484352 00000100:00100000:3.0:1790771988.795582:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428484352 00000100:00100000:3.0:1790771988.795608:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790771988.795615:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428484352:12345-0@lo:101: 00010000:00010000:3.0:1790771988.795624:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771988.795637:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fd0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fd08 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771988.795658:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd08 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771988.795667:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd08 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771988.795675:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2e00, rc 0) 00000100:00100000:3.0:1790771988.795709:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428484352:12345-0@lo:101: Request processed in 95us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771988.795715:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790771988.795898:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428484352:0@lo:101: 00010000:00010000:1.0:1790771988.795917:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.795925:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771988.795974:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428484480:0@lo:501: 00000100:00100000:1.0:1790771988.796000:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771988.796018:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25089af00 going to sleep for 11 seconds 00000100:00100000:2.0:1790771988.796103:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428484480 00000100:00100000:2.0:1790771988.796107:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428484480 00000100:00100000:2.0:1790771988.796128:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790771988.796135:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428484480:12345-0@lo:501: 00000100:00100000:2.0:1790771988.796421:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428484480:12345-0@lo:501: Request processed in 285us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771988.796429:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790771988.796502:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428484480:0@lo:501: 00000100:00100000:1.0:1790771988.796542:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428484608:0@lo:503: 00000100:00100000:1.0:1790771988.796705:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771988.796733:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25089af00 going to sleep for 11 seconds 00000100:00100000:2.0:1790771988.796772:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428484608 00000100:00100000:2.0:1790771988.796777:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428484608 00000100:00100000:2.0:1790771988.796818:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790771988.796825:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428484608:12345-0@lo:503: 00000100:00100000:2.0:1790771988.797120:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428484608:12345-0@lo:503: Request processed in 294us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771988.797128:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790771988.797329:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428484608:0@lo:503: 00000100:00100000:1.0:1790771988.800799:0:6775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6775:1877760428484736:0@lo:502: 00000100:00100000:1.0:1790771988.800907:0:6775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771988.800950:0:6775:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25089af00 going to sleep for 11 seconds 00000100:00100000:0.0:1790771988.802574:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428484736 00000100:00100000:0.0:1790771988.802590:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428484736 00000100:00100000:0.0:1790771988.802652:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790771988.802673:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:6775:x1877760428484736:12345-0@lo:502: 00000100:00100000:0.0:1790771988.803067:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:6775:x1877760428484736:12345-0@lo:502: Request processed in 394us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771988.803075:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790771988.803762:0:6775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6775:1877760428484736:0@lo:502: 00000020:01000000:1.0:1790771988.804039:0:6775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790771988.804048:0:6775:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790771988.804059:0:6775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790771988.804062:0:6775:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790771988.804068:0:6775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790771988.804072:0:6775:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.127@tcp to nid 0x20000c0a8ce7f (192.168.206.127@tcp) 00000020:01000000:1.0:1790771988.804100:0:6775:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790771988.804103:0:6775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790771988.804139:0:6775:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8df2590719c0) 00000020:00000080:1.0:1790771988.804164:0:6775:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1790771988.804172:0:6775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790771988.804282:0:6775:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790771988.804289:0:6775:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790771988.804297:0:6775:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a8fd1d 00010000:00080000:1.0:1790771988.804330:0:6775:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df248a87000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:1.0:1790771988.804757:0:6775:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1790771988.910175:0:6775:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790771988.910208:0:6775:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790771988.913053:0:6775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790771988.915063:0:6775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790771988.915142:0:6775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1790771988.915219:0:6775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1790771988.930265:0:6779:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790771988.930274:0:6779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790771988.931882:0:6775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790771988.931901:0:6775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790771988.932021:0:6775:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790771988.932051:0:6775:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf68d9a7d6a8fd24 00000100:00080000:3.0:1790771988.932063:0:6775:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790771988.932076:0:6775:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df248a87000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1790771988.932122:0:6775:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27401c700 x1877760428484864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790771988.932218:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428484864:0@lo:8: 00000100:00100000:1.0:1790771988.932317:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790771988.932453:0:6775:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790771988.932544:0:6775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790771988.932577:0:6775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790771988.932580:0:6775:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790771988.932584:0:6775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790771988.932588:0:6775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790771988.932590:0:6775:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790771988.932593:0:6775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790771988.932595:0:6775:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790771988.932620:0:6775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6775:1877760428484992:0@lo:502: 00000100:00100000:3.0:1790771988.932664:0:6775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771988.932687:0:6775:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f78480 going to sleep for 11 seconds 00000100:00100000:3.0:1790771988.932711:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428484992 00000100:00100000:3.0:1790771988.932719:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428484992 00000100:00100000:3.0:1790771988.932774:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790771988.932784:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:6775:x1877760428484992:12345-0@lo:502: 00000100:00100000:3.0:1790771988.933072:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:6775:x1877760428484992:12345-0@lo:502: Request processed in 288us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771988.933082:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790771988.933146:0:6775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:6775:1877760428484992:0@lo:502: 00000020:01000000:3.0:1790771988.933173:0:6775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790771988.933184:0:6775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790771988.933186:0:6775:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790771988.933191:0:6775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1790771988.933584:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428484864 00000100:00100000:0.0:1790771988.933590:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428484864 00000100:00100000:0.0:1790771988.933621:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790771988.933628:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1877760428484864:12345-0@lo:8: 00010000:00080000:0.0:1790771988.933653:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:0.0:1790771988.933684:0:6677:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf68d9a7d6a8fd2b 00002000:00100000:0.0:1790771988.933722:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8df243046800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790771988.933727:0:6677:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1790771988.933731:0:6677:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790771988.933931:0:6677:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790771988.934142:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790771988.934170:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8df243043000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790771988.934377:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1877760428484864:12345-0@lo:8: Request processed in 747us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771988.934385:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790771988.934454:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27401c700 x1877760428484864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790771998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790771988.934466:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790771988.934474:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790771988.934484:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790771988.934489:0:3292:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790771988.934491:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df248a87000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790771988.934568:0:3292:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790771988.934574:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428484864:0@lo:8: 00000020:01000000:2.0:1790771988.934702:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1790771988.934738:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790771988.934762:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771988.934774:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790771988.934784:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790771988.934787:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df258e04d40 from 1 10000000:01000000:2.0:1790771988.934791:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1790771988.935538:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428485120:0@lo:400: 00000100:00100000:3.0:1790771988.935616:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771988.935651:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790771988.935658:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428485248:0@lo:400: 00000100:00100000:3.0:1790771988.935684:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771988.936861:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428485120 00000100:00100000:1.0:1790771988.936873:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428485120 00000100:00100000:1.0:1790771988.936920:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428485248 00000100:00100000:1.0:1790771988.936924:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428485248 00000100:00100000:1.0:1790771988.936973:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790771988.936992:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428485120:12345-0@lo:400: 00000100:00100000:1.0:1790771988.937077:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428485120:12345-0@lo:400: Request processed in 87us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771988.937086:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790771988.937104:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790771988.937111:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428485248:12345-0@lo:400: 00000100:00100000:1.0:1790771988.937142:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428485248:12345-0@lo:400: Request processed in 32us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771988.937148:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790771988.937209:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab65500 x1877760428485248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790771988.937225:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428485248:0@lo:400: 00010000:00080000:1.0:1790771988.937235:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab67800 x1877760428485120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790771988.937242:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428485120:0@lo:400: 00010000:00010000:2.0:1790771988.937588:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771988.937612:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771988.937626:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771988.937649:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428485376:0@lo:101: 00000100:00100000:2.0:1790771988.937707:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771988.937734:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428485376 00000100:00100000:1.0:1790771988.937741:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428485376 00000100:00100000:2.0:1790771988.937743:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2437e6300 going to sleep for 11 seconds 00000100:00100000:1.0:1790771988.938243:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790771988.938253:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428485376:12345-0@lo:101: 00010000:00010000:1.0:1790771988.938265:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771988.938295:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df28204fe00/0xdf68d9a7d6a8fd39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fd32 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.938325:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df28204fe00/0xdf68d9a7d6a8fd39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd32 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.938350:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df28204fe00/0xdf68d9a7d6a8fd39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd32 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.938359:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df28204fe00, rc 0) 00000100:00100000:1.0:1790771988.938404:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428485376:12345-0@lo:101: Request processed in 154us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771988.938411:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790771988.938460:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428485376:0@lo:101: 00010000:00010000:1.0:1790771988.938476:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771988.938486:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771988.938632:0:6779:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:0.0:1790771988.938667:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790771988.939076:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428485504:0@lo:501: 00000100:00100000:1.0:1790771988.939128:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771988.939161:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771988.939395:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428485504 00000100:00100000:0.0:1790771988.939403:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428485504 00000100:00100000:0.0:1790771988.939436:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790771988.939446:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428485504:12345-0@lo:501: 00000100:00100000:0.0:1790771988.939717:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428485504:12345-0@lo:501: Request processed in 272us (586us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790771988.939726:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790771988.939921:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428485504:0@lo:501: 10000000:01000000:0.0:1790771988.940028:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790771988.940038:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771988.940049:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771988.940264:0:6779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 155084713077ns, next at 0ns, rc = 0 00000004:00080000:1.0:1790771989.038346:0:6780:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790771989.038386:0:6780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6780:1877760428485760:0@lo:7: 00000100:00100000:1.0:1790771989.038463:0:6780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771989.038517:0:6780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bb780 going to sleep for 11 seconds 00000100:00100000:1.0:1790771989.038663:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428485632:0@lo:13: 00000100:00100000:1.0:1790771989.038693:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771989.038997:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428485760 00000100:00100000:3.0:1790771989.039009:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428485760 00000100:00100000:3.0:1790771989.039188:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790771989.039202:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6780:x1877760428485760:12345-0@lo:7: 00000100:00080000:1.0:1790771989.040239:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790771989.043768:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428485632 00000100:00100000:0.0:1790771989.043786:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428485632 00000100:00100000:0.0:1790771989.044134:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790771989.044147:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1877760428485632:12345-0@lo:13: 00002000:00000024:0.0:1790771989.044186:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1790771989.044287:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1877760428485632:12345-0@lo:13: Request processed in 143us (5591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771989.044295:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790771989.044401:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df258e85500 x1877760428485632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790771989.044424:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428485632:0@lo:13: 00002000:00080000:3.0:1790771989.066199:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1790771989.066211:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790771989.066322:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6780:x1877760428485760:12345-0@lo:7: Request processed in 27118us (27853us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771989.066333:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790771989.066427:0:6780:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df258e87100 x1877760428485760/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790772005 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790771989.066445:0:6780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6780:1877760428485760:0@lo:7: 00000004:00080000:3.0:1790771989.066464:0:6780:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790771989.067236:0:6780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6780:1877760428485888:0@lo:5: 00000100:00100000:3.0:1790771989.067288:0:6780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771989.067332:0:6780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771989.067368:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428485888 00000100:00100000:3.0:1790771989.067375:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428485888 00000100:00100000:3.0:1790771989.067425:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790771989.067437:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6780:x1877760428485888:12345-0@lo:5: 00002000:00080000:3.0:1790771989.067476:0:6677:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790771989.067480:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790771989.068085:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6780:x1877760428485888:12345-0@lo:5: Request processed in 650us (795us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790771989.068094:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790771989.068138:0:6780:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27401c380 x1877760428485888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772005 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790771989.068155:0:6780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6780:1877760428485888:0@lo:5: 00000004:00080000:3.0:1790771989.068166:0:6780:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790771989.068194:0:6780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6780:1877760428486016:0@lo:700: 00000100:00100000:3.0:1790771989.068224:0:6780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771989.068246:0:6780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771989.068269:0:6685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428486016 00000100:00100000:3.0:1790771989.068273:0:6685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428486016 00000100:00100000:3.0:1790771989.068302:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790771989.068309:0:6685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6780:x1877760428486016:12345-0@lo:700: 00000100:00100000:3.0:1790771989.068336:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1877760428486144:0@lo:700: 00000100:00100000:3.0:1790771989.068363:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771989.068378:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771989.068409:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428486144 00000100:00100000:3.0:1790771989.068412:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428486144 00000100:00100000:3.0:1790771989.068447:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790771989.068453:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1877760428486144:12345-0@lo:700: 00000004:00080000:3.0:1790771989.124490:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1790771989.153706:0:5830:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1790771989.166833:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1877760428486144:12345-0@lo:700: Request processed in 98371us (98460us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771989.166859:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790771989.166926:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27401c700 x1877760428486144/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790772005 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790771989.166942:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1877760428486144:0@lo:700: 40000000:02000000:3.0:1790771989.166957:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1790771989.232980:0:6685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6780:x1877760428486016:12345-0@lo:700: Request processed in 164659us (164743us total) trans 0 rc 0/0 00010000:00080000:3.0:1790771989.232992:0:6780:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27401ed80 x1877760428486016/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790772005 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790771989.233006:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790771989.233010:0:6780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6780:1877760428486016:0@lo:700: 00000001:00100000:0.0:1790771989.233150:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790771989.233171:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:1.0:1790771989.276690:0:6780:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1790771989.283500:0:6780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6780:1877760428486272:0@lo:5: 00000100:00100000:0.0:1790771989.283637:0:6780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771989.283693:0:6780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2460a5540 going to sleep for 11 seconds 00000100:00100000:3.0:1790771989.283699:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428486272 00000100:00100000:3.0:1790771989.283709:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428486272 00000100:00100000:3.0:1790771989.283777:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790771989.283788:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6780:x1877760428486272:12345-0@lo:5: 00002000:00080000:1.0:1790771989.289748:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790771989.289776:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00010000:00080000:2.0:1790771989.298983:0:6780:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df26fad7800 x1877760428486272/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772005 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790771989.299005:0:6780:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790771989.299025:0:6780:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8df26fad7800 x1877760428486272/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772005 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790771989.299037:0:6780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6780:1877760428486272:0@lo:5: 00000004:00080000:2.0:1790771989.299053:0:6780:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000100:00100000:1.0:1790771989.299145:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6780:x1877760428486272:12345-0@lo:5: Request processed in 15357us (15506us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790771989.299161:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790771989.537931:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771990.561472:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771991.583755:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771992.610487:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771993.631726:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790771994.054522:0:7047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1790771994.080060:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428486400:0@lo:400: 00000100:00100000:2.0:1790771994.080142:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771994.080203:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790771994.080209:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428486784:0@lo:400: 00000100:00100000:2.0:1790771994.080235:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771994.080264:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428486528:0@lo:400: 00000100:00100000:2.0:1790771994.080286:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771994.080303:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790771994.080307:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428486656:0@lo:400: 00000100:00100000:2.0:1790771994.080333:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771994.080483:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428486400 00000100:00100000:2.0:1790771994.080490:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428486400 00000100:00100000:2.0:1790771994.080544:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790771994.080573:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3294:x1877760428486400:12345-0@lo:400: 00000100:00100000:2.0:1790771994.080621:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3294:x1877760428486400:12345-0@lo:400: Request processed in 50us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771994.080628:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790771994.080667:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428486784 00000100:00100000:2.0:1790771994.080670:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428486784 00000100:00100000:2.0:1790771994.080705:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790771994.080711:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3294:x1877760428486784:12345-0@lo:400: 00000100:00100000:2.0:1790771994.080745:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3294:x1877760428486784:12345-0@lo:400: Request processed in 34us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771994.080751:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790771994.080769:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428486528 00000100:00100000:2.0:1790771994.081532:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428486528 00000100:00100000:2.0:1790771994.081672:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428486656 00000100:00100000:2.0:1790771994.081676:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428486656 00000100:00100000:1.0:1790771994.084301:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790771994.084318:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428486528:12345-0@lo:400: 00000100:00100000:1.0:1790771994.084452:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428486528:12345-0@lo:400: Request processed in 140us (4163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771994.084460:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790771994.084483:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790771994.084490:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428486656:12345-0@lo:400: 00000100:00100000:1.0:1790771994.084530:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428486656:12345-0@lo:400: Request processed in 41us (4196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771994.084536:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790771994.084721:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab67100 x1877760428486656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790771994.084737:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428486656:0@lo:400: 00010000:00080000:0.0:1790771994.084750:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab66680 x1877760428486528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790771994.084758:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428486528:0@lo:400: 00000100:00080000:0.0:1790771994.085964:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790771994.085971:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790771994.086020:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab67800 x1877760428486784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790771994.086035:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428486784:0@lo:400: 00000100:00100000:0.0:1790771994.086046:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428486400:0@lo:400: 00000100:00100000:0.0:1790771994.089745:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428486912:0@lo:13: 00000100:00100000:0.0:1790771994.089952:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771994.098874:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428486912 00000100:00100000:2.0:1790771994.098887:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428486912 00000100:00100000:2.0:1790771994.098969:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790771994.098983:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1877760428486912:12345-0@lo:13: 00002000:00000024:2.0:1790771994.099020:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790771994.099122:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1877760428486912:12345-0@lo:13: Request processed in 145us (9171us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771994.099130:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790771994.099179:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27401ed80 x1877760428486912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790771994.099202:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428486912:0@lo:13: 00010000:00010000:3.0:1790771994.657900:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790771994.748610:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1790771995.681089:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771996.705315:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771997.729361:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771998.757126:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790771999.200615:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428487040:0@lo:13: 00000100:00100000:2.0:1790771999.200689:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771999.200948:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428487040 00000100:00100000:2.0:1790771999.200957:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428487040 00000100:00100000:2.0:1790771999.201017:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790771999.201025:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428487040:12345-0@lo:13: 00002000:00000024:2.0:1790771999.201058:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790771999.201099:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428487040:12345-0@lo:13: Request processed in 75us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771999.201106:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790771999.201140:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab65880 x1877760428487040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790771999.201150:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790771999.201178:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428487040:0@lo:13: 00000100:00080000:0.0:1790771999.201221:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790771999.209130:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790771999.209155:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428487168:0@lo:400: 00000100:00100000:2.0:1790771999.209227:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771999.209277:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428487296:0@lo:400: 00000100:00100000:2.0:1790771999.209307:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771999.209329:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790771999.209335:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428487424:0@lo:400: 00000100:00100000:2.0:1790771999.209357:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771999.209390:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428487168 00000100:00100000:2.0:1790771999.209398:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428487168 00000100:00100000:2.0:1790771999.209442:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790771999.209451:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3295:x1877760428487168:12345-0@lo:400: 00000100:00100000:2.0:1790771999.209511:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3295:x1877760428487168:12345-0@lo:400: Request processed in 61us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771999.209518:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790771999.209574:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428487296 00000100:00100000:2.0:1790771999.209578:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428487296 00000100:00100000:2.0:1790771999.209602:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428487424 00000100:00100000:2.0:1790771999.209606:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428487424 00000100:00100000:2.0:1790771999.209634:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790771999.209642:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428487296:12345-0@lo:400: 00000100:00100000:2.0:1790771999.209681:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428487296:12345-0@lo:400: Request processed in 39us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771999.209687:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790771999.209700:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790771999.209706:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428487424:12345-0@lo:400: 00000100:00100000:2.0:1790771999.209746:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428487424:12345-0@lo:400: Request processed in 40us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771999.209765:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790771999.209807:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428487168:0@lo:400: 00000100:00080000:2.0:1790771999.209831:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790771999.209854:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab67b80 x1877760428487424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790771999.209865:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428487424:0@lo:400: 00010000:00080000:2.0:1790771999.209875:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab65180 x1877760428487296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790771999.209883:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428487296:0@lo:400: 00010000:00010000:0.0:1790771999.775849:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772000.800503:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772001.823715:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772002.848774:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772003.871898:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772004.321912:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428487680:0@lo:400: 00000100:00100000:2.0:1790772004.321994:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772004.322054:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772004.322071:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428487552:0@lo:400: 00000100:00100000:2.0:1790772004.322104:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772004.322137:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428487808:0@lo:400: 00000100:00100000:2.0:1790772004.322160:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772004.322178:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772004.322182:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428487936:0@lo:400: 00000100:00100000:2.0:1790772004.322202:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772004.323797:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428487680 00000100:00100000:2.0:1790772004.323813:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428487680 00000100:00100000:2.0:1790772004.323877:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428487808 00000100:00100000:2.0:1790772004.323891:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428487808 00000100:00100000:2.0:1790772004.323927:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772004.323937:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428487680:12345-0@lo:400: 00000100:00100000:2.0:1790772004.324030:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428487680:12345-0@lo:400: Request processed in 94us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772004.324037:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772004.324056:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772004.324062:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428487808:12345-0@lo:400: 00000100:00100000:2.0:1790772004.324097:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428487808:12345-0@lo:400: Request processed in 35us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772004.324103:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772004.324122:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428487552 00000100:00100000:2.0:1790772004.324126:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428487552 00000100:00100000:2.0:1790772004.324153:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790772004.324158:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3296:x1877760428487552:12345-0@lo:400: 00000100:00100000:2.0:1790772004.324189:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3296:x1877760428487552:12345-0@lo:400: Request processed in 31us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772004.324195:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790772004.324796:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428487936 00000100:00100000:2.0:1790772004.324802:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428487936 00000100:00100000:2.0:1790772004.324843:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772004.324850:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428487936:12345-0@lo:400: 00000100:00100000:2.0:1790772004.324890:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428487936:12345-0@lo:400: Request processed in 40us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772004.324897:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790772004.324916:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790772004.324921:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790772004.324970:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab66300 x1877760428487936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772004.324987:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428487936:0@lo:400: 00010000:00080000:2.0:1790772004.324999:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab65880 x1877760428487808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772004.325007:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428487808:0@lo:400: 00000100:00100000:2.0:1790772004.325038:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428487552:0@lo:400: 00010000:00080000:2.0:1790772004.325050:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab67b80 x1877760428487680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772004.325059:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428487680:0@lo:400: 00000100:00100000:2.0:1790772004.328305:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772004.328334:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428488064:0@lo:13: 00000100:00100000:2.0:1790772004.328425:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772004.328497:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428488064 00000100:00100000:1.0:1790772004.328507:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428488064 00000100:00100000:2.0:1790772004.328679:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772004.328811:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428488064:12345-0@lo:13: 00002000:00000024:2.0:1790772004.328858:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772004.328922:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428488064:12345-0@lo:13: Request processed in 116us (497us total) trans 0 rc 0/0 00010000:00080000:3.0:1790772004.328988:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab67b80 x1877760428488064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772004.329010:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428488064:0@lo:13: 00000100:00100000:2.0:1790772004.329338:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1790772004.897981:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790772005.368265:0:7610:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790772005.368271:0:7610:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790772005.368419:0:7610:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df273e99800 00000020:01000004:0.0:1790772005.368438:0:7610:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1790772005.368470:0:7610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790772005.368488:0:7610:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8df2581ccd40) 00000020:00000080:0.0:1790772005.368513:0:7610:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790772005.402985:0:7610:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790772005.403356:0:7610:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790772005.440231:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790772005.450903:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790772005.450952:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790772005.451525:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790772005.451693:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790772005.452705:0:7610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790772005.452722:0:7610:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790772005.452738:0:7610:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdf68d9a7d6a8fd47 00000020:01000004:2.0:1790772005.452747:0:7610:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790772005.452774:0:7610:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790772005.452778:0:7610:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790772005.452785:0:7610:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790772005.452813:0:7610:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790772005.452818:0:7610:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1790772005.496644:0:7610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790772005.496695:0:7610:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.127@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1790772005.496700:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790772005.496702:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790772005.496704:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772005.496710:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772005.496712:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772005.496713:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772005.496714:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772005.496716:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790772005.496717:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790772005.496719:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772005.496721:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790772005.496725:0:7610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1790772005.496727:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790772005.496728:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790772005.496729:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772005.496730:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790772005.496731:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772005.496731:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772005.496732:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772005.496733:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790772005.496734:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790772005.496735:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772005.496736:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790772005.496767:0:7610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790772005.496789:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428488192:0@lo:253: 00000100:00100000:1.0:1790772005.497381:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.497497:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772005.497979:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428488192 00000100:00100000:2.0:1790772005.497992:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428488192 00000100:00100000:0.0:1790772005.498316:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790772005.498329:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:7610:x1877760428488192:12345-0@lo:253: 20000000:01000000:0.0:1790772005.498373:0:5818:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790772005.498379:0:5818:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1790772005.498385:0:5818:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1790772005.498389:0:5818:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1790772005.505243:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772005.505523:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1790772005.505541:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1790772005.507850:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1790772005.507882:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1790772005.507926:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1790772005.508142:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1790772005.508935:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1790772005.508963:0:5818:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.127@tcp 20000000:01000000:0.0:1790772005.508966:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.127@tcp (null) (null) (null) 00000040:00080000:0.0:1790772005.509224:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1790772005.509235:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790772005.509294:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1790772005.509303:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.127@tcp (null) (null) 00000040:00080000:0.0:1790772005.509342:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1790772005.509351:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790772005.509380:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1790772005.509431:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1790772005.513610:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1790772005.513653:0:5818:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.127@tcp 20000000:01000000:0.0:1790772005.513656:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.127@tcp (null) (null) (null) 00000040:00080000:0.0:1790772005.513693:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1790772005.513701:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790772005.513732:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1790772005.513750:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.127@tcp (null) (null) 00000040:00080000:2.0:1790772005.514782:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1790772005.514809:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1790772005.514934:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1790772005.514990:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1790772005.515017:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1790772005.515020:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1790772005.515027:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790772005.515029:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790772005.515031:0:5818:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790772005.515058:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790772005.515062:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790772005.515108:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790772005.515111:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790772005.517043:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1790772005.517147:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1790772005.517219:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1790772005.517605:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1790772005.517653:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1790772005.517689:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1790772005.517702:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790772005.517704:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790772005.518674:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1790772005.518770:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1790772005.518821:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1790772005.520493:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1790772005.520987:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1790772005.521254:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1790772005.521275:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1790772005.521279:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790772005.531146:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1790772005.531703:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1790772005.531772:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1790772005.531879:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1790772005.531894:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790772005.531897:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790772005.533196:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1790772005.533280:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1790772005.533342:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1790772005.533774:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1790772005.533957:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1790772005.534040:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1790772005.534062:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790772005.534086:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534107:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2414a3c00/0xdf68d9a7d6a8fc9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc98 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534114:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df28204f200/0xdf68d9a7d6a8fcc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcc2 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534122:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fcf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcec expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534129:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fd0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd08 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534136:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df28204fe00/0xdf68d9a7d6a8fd39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd32 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534145:0:5818:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534270:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df28204fe00/0xdf68d9a7d6a8fd39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd32 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534290:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df28204fe00/0xdf68d9a7d6a8fd39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd32 expref: 16 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772005.534307:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877760428488320:0@lo:104: 00000100:00100000:2.0:1790772005.534386:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772005.534463:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd08 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534471:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fd0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd08 expref: 16 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772005.534480:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877760428488448:0@lo:104: 00010000:00010000:2.0:1790772005.534519:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fcf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcec expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534528:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fcf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcec expref: 16 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772005.534536:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877760428488576:0@lo:104: 00010000:00010000:2.0:1790772005.534606:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df28204f200/0xdf68d9a7d6a8fcc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcc2 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534614:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df28204f200/0xdf68d9a7d6a8fcc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcc2 expref: 16 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772005.534622:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877760428488704:0@lo:104: 00010000:00010000:2.0:1790772005.534655:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2414a3c00/0xdf68d9a7d6a8fc9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc98 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.534662:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df2414a3c00/0xdf68d9a7d6a8fc9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc98 expref: 16 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772005.534670:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877760428488832:0@lo:104: 00000100:00100000:2.0:1790772005.534689:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772005.535221:0:5807:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790772005.535246:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772005.535279:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772005.535299:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772005.535308:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772005.535320:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428488320 00000100:00100000:3.0:1790772005.535329:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428488320 00000100:00100000:3.0:1790772005.535380:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428488448 00000100:00100000:3.0:1790772005.535384:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428488448 00000100:00100000:3.0:1790772005.535396:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428488576 00000100:00100000:3.0:1790772005.535399:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428488576 00000100:00100000:3.0:1790772005.535407:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428488704 00000100:00100000:3.0:1790772005.535409:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428488704 00000100:00100000:3.0:1790772005.535417:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428488832 00000100:00100000:3.0:1790772005.535419:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428488832 00000100:00100000:3.0:1790772005.535431:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790772005.535455:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2440f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+7:5818:x1877760428488320:12345-0@lo:104: 00010000:00010000:3.0:1790772005.535471:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.535546:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790772005.535576:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2440f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+7:5818:x1877760428488320:12345-0@lo:104: Request processed in 137us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.535583:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790772005.535633:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790772005.535640:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+6:5818:x1877760428488448:12345-0@lo:104: 00010000:00010000:3.0:1790772005.535649:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.535685:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790772005.535691:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+6:5818:x1877760428488448:12345-0@lo:104: Request processed in 52us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.535697:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790772005.535859:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790772005.535868:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:5818:x1877760428488576:12345-0@lo:104: 00010000:00010000:3.0:1790772005.535877:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.535909:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790772005.535914:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:5818:x1877760428488576:12345-0@lo:104: Request processed in 49us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772005.535994:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877760428488320:0@lo:104: 00000100:00100000:1.0:1790772005.536016:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877760428488448:0@lo:104: 00000100:00100000:1.0:1790772005.536024:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877760428488576:0@lo:104: 00010000:00010000:1.0:1790772005.536053:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790772005.536067:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536076:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772005.536081:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536090:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772005.536098:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772005.536105:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772005.536141:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536148:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772005.536168:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536174:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fd32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd39 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536192:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772005.536195:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536201:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df28204e000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772005.536203:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536220:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772005.536227:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772005.536232:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772005.536245:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536250:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772005.536267:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536273:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8fd08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd0f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536285:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772005.536288:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536295:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772005.536298:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536304:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772005.536309:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772005.536321:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772005.536334:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536341:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772005.536346:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536353:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df241390a00/0xdf68d9a7d6a8fcec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fcf3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536363:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772005.536365:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772005.536367:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772005.536384:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772005.536399:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428488960:0@lo:103: 00000100:00100000:1.0:1790772005.536437:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.536500:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428489088:0@lo:103: 00000100:00100000:1.0:1790772005.536523:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.536541:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772005.536546:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428489216:0@lo:103: 00000100:00100000:1.0:1790772005.536587:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.536621:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428488960 00000100:00100000:1.0:1790772005.536627:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428488960 00010000:00010000:1.0:1790772005.536654:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df28204fe00/0xdf68d9a7d6a8fd39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd32 expref: 17 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772005.536670:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428489088 00000100:00100000:1.0:1790772005.536678:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428489088 00010000:00010000:1.0:1790772005.536690:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fd0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd08 expref: 18 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772005.536700:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428489216 00000100:00100000:1.0:1790772005.536703:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428489216 00010000:00010000:1.0:1790772005.536712:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fcf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcec expref: 19 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772005.536740:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772005.536747:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428488960:12345-0@lo:103: 00010000:00010000:1.0:1790772005.536760:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772005.536765:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df28204fe00/0xdf68d9a7d6a8fd39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd32 expref: 19 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536777:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df28204fe00/0xdf68d9a7d6a8fd39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd32 expref: 19 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536793:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df28204fe00/0xdf68d9a7d6a8fd39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd32 expref: 19 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536809:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772005.536839:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:3295:x1877760428488960:12345-0@lo:103: Request processed in 93us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772005.536846:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772005.536863:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772005.536869:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:3293:x1877760428489088:12345-0@lo:103: 00010000:00010000:1.0:1790772005.536876:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772005.536880:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fd0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd08 expref: 17 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536898:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fd0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd08 expref: 17 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536907:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fd0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd08 expref: 17 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536919:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772005.536950:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3293:x1877760428489088:12345-0@lo:103: Request processed in 81us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772005.536956:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772005.536969:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772005.536975:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:3293:x1877760428489216:12345-0@lo:103: 00010000:00010000:1.0:1790772005.536982:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772005.536986:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fcf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcec expref: 15 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.536994:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fcf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcec expref: 15 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.537003:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fcf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcec expref: 15 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.537012:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772005.537033:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:3293:x1877760428489216:12345-0@lo:103: Request processed in 58us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772005.537038:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772005.537075:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428489216:0@lo:103: 00000100:00100000:1.0:1790772005.537082:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428489088:0@lo:103: 00000100:00100000:1.0:1790772005.537117:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428488960:0@lo:103: 00010000:00010000:2.0:1790772005.538958:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772005.539348:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790772005.539393:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790772005.539411:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:5818:x1877760428488704:12345-0@lo:104: 00010000:00010000:3.0:1790772005.539434:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.539846:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790772005.539855:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:5818:x1877760428488704:12345-0@lo:104: Request processed in 453us (4553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.539862:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790772005.539878:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772005.539885:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:5818:x1877760428488832:12345-0@lo:104: 00010000:00010000:3.0:1790772005.539895:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772005.539966:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877760428488704:0@lo:104: 00000100:00100000:1.0:1790772005.539975:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877760428488832:0@lo:104: 00010000:00010000:1.0:1790772005.540022:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.540068:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772005.540077:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.540084:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030600 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1790772005.540089:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.540098:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772005.540106:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772005.540111:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772005.540245:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.540253:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790772005.540304:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428489344:0@lo:103: 00000100:00100000:0.0:1790772005.540347:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790772005.540400:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.540408:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fcc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fcc9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.540421:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772005.540423:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.540429:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772005.540432:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.540449:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772005.540456:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772005.540478:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772005.540492:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.540498:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790772005.540523:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1790772005.540529:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:5818:x1877760428488832:12345-0@lo:104: Request processed in 645us (5220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.540536:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772005.540586:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428489472:0@lo:103: 00000100:00100000:3.0:1790772005.540611:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772005.540650:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428489344 00000100:00100000:3.0:1790772005.540657:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428489344 00010000:00010000:3.0:1790772005.540679:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df28204f200/0xdf68d9a7d6a8fcc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcc2 expref: 14 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772005.540701:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428489472 00000100:00100000:3.0:1790772005.540703:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428489472 00010000:00010000:3.0:1790772005.540711:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2414a3c00/0xdf68d9a7d6a8fc9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc98 expref: 15 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772005.540735:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790772005.540741:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:3295:x1877760428489344:12345-0@lo:103: 00010000:00010000:3.0:1790772005.540751:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772005.540757:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df28204f200/0xdf68d9a7d6a8fcc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcc2 expref: 15 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.540767:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df28204f200/0xdf68d9a7d6a8fcc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcc2 expref: 15 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.540781:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df28204f200/0xdf68d9a7d6a8fcc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcc2 expref: 15 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.540985:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772005.541091:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772005.541210:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.541218:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df2414a2400/0xdf68d9a7d6a8fc98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc9f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.541236:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772005.541238:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772005.541239:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772005.541259:0:5809:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790772005.541267:0:5809:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1790772005.543367:0:5808:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790772005.543395:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772005.543412:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:3296:x1877760428489472:12345-0@lo:103: 00010000:00010000:2.0:1790772005.543437:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772005.543461:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2414a3c00/0xdf68d9a7d6a8fc9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc98 expref: 14 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543479:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2414a3c00/0xdf68d9a7d6a8fc9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc98 expref: 14 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543499:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a3c00/0xdf68d9a7d6a8fc9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc98 expref: 14 pid: 5818 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543514:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543524:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543542:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543585:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543593:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543600:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543606:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391600 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772005.543611:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543620:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543640:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543651:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772005.543745:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:3296:x1877760428489472:12345-0@lo:103: Request processed in 339us (3131us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.543753:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772005.543829:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428489472:0@lo:103: 00010000:00010000:2.0:1790772005.543863:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543872:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.543890:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd4e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790772005.543908:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790772005.544300:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3295:x1877760428489344:12345-0@lo:103: Request processed in 3555us (3948us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.544309:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772005.544853:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428489344:0@lo:103: 00000100:00100000:3.0:1790772005.628519:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:7610:x1877760428488192:12345-0@lo:253: Request processed in 130178us (131126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.628591:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790772005.628815:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428488192:0@lo:253: 10000000:01000000:1.0:1790772005.628833:0:7610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790772005.628837:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790772005.628839:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790772005.628840:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790772005.628841:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1790772005.628843:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790772005.628844:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790772005.628846:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790772005.628848:0:7610:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790772005.628850:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790772005.628851:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790772005.628874:0:7610:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df273e99800 from lustre-OST0001 10000000:01000000:1.0:1790772005.628905:0:7610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1790772005.628908:0:7610:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790772005.628918:0:7610:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df258e04d40 local copy 10000000:01000000:1.0:1790772005.628929:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790772005.628972:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.628985:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.628995:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772005.629269:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428489600:0@lo:101: 00000100:00100000:1.0:1790772005.629320:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.629436:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772005.630329:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428489600 00000100:00100000:2.0:1790772005.630341:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428489600 00000100:00100000:2.0:1790772005.630473:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790772005.630485:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+11:7610:x1877760428489600:12345-0@lo:101: 00010000:00010000:2.0:1790772005.630506:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772005.630531:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fd55 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.630594:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd55 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.630607:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd55 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.630617:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241391600, rc 0) 00000100:00100000:2.0:1790772005.630684:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:7610:x1877760428489600:12345-0@lo:101: Request processed in 201us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.630691:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790772005.630854:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428489600:0@lo:101: 00010000:00010000:1.0:1790772005.630872:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.630883:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772005.631034:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428489728:0@lo:501: 00000100:00100000:1.0:1790772005.631073:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.632563:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772005.633829:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428489728 00000100:00100000:0.0:1790772005.633846:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428489728 00000100:00100000:3.0:1790772005.635902:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790772005.635929:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:7610:x1877760428489728:12345-0@lo:501: 00000100:00100000:3.0:1790772005.636529:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:7610:x1877760428489728:12345-0@lo:501: Request processed in 609us (5452us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790772005.636539:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790772005.636991:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428489728:0@lo:501: 10000000:01000000:1.0:1790772005.637073:0:7610:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790772005.637121:0:7610:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790772005.637131:0:7610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.637229:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.637239:0:7610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.637315:0:7610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790772005.637352:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df273e99800 10000000:01000000:1.0:1790772005.637358:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790772005.637363:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790772005.637367:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790772005.637372:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790772005.637375:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790772005.637413:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.637422:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.637432:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772005.637465:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428489856:0@lo:101: 00000100:00100000:1.0:1790772005.637521:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.637588:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772005.637663:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428489856 00000100:00100000:0.0:1790772005.637671:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428489856 00000100:00100000:0.0:1790772005.637804:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790772005.637815:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:7610:x1877760428489856:12345-0@lo:101: 00010000:00010000:0.0:1790772005.637828:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772005.637850:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a8fd6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fd63 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.637879:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a8fd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd63 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.637892:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a8fd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd63 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.637901:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031e00, rc 0) 00000100:00100000:0.0:1790772005.637941:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428489856:12345-0@lo:101: Request processed in 129us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772005.637948:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790772005.638168:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428489856:0@lo:101: 00010000:00010000:1.0:1790772005.638183:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.638204:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772005.638296:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428489984:0@lo:501: 00000100:00100000:1.0:1790772005.638330:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.638360:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772005.638510:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428489984 00000100:00100000:3.0:1790772005.638515:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428489984 00000100:00100000:3.0:1790772005.638541:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790772005.638564:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428489984:12345-0@lo:501: 00000100:00100000:3.0:1790772005.638940:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428489984:12345-0@lo:501: Request processed in 391us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.638948:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790772005.639145:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428489984:0@lo:501: 00000100:00100000:1.0:1790772005.639250:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490112:0@lo:503: 00000100:00100000:1.0:1790772005.639296:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.639329:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772005.639381:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428490112 00000100:00100000:3.0:1790772005.639387:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428490112 00000100:00100000:3.0:1790772005.639420:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772005.639427:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428490112:12345-0@lo:503: 00000100:00100000:3.0:1790772005.639692:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428490112:12345-0@lo:503: Request processed in 264us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.639700:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790772005.639938:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490112:0@lo:503: 00000040:00080000:1.0:1790772005.642167:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790772005.642279:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490240:0@lo:502: 00000100:00100000:1.0:1790772005.642372:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.642430:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a600 going to sleep for 11 seconds 00010000:00010000:2.0:1790772005.642523:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772005.642535:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.642546:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9600 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772005.642565:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.642585:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772005.642593:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772005.642599:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772005.642626:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.642634:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772005.642666:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.642674:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9600/0xdf68d9a7d6a8fd55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf68d9a7d6a8fd5c expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.642688:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772005.642690:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772005.642692:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772005.642875:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772005.642890:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428490368:0@lo:103: 00000100:00100000:0.0:1790772005.642925:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772005.643000:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428490368 00000100:00100000:3.0:1790772005.643094:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428490240 00000100:00100000:3.0:1790772005.643104:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428490240 00000100:00100000:3.0:1790772005.643156:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790772005.643167:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428490240:12345-0@lo:502: 00000100:00100000:3.0:1790772005.643408:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428490240:12345-0@lo:502: Request processed in 241us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.643424:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772005.643579:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490240:0@lo:502: 00000100:00100000:2.0:1790772005.643905:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428490368 00000100:00100000:2.0:1790772005.643954:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772005.643962:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:3294:x1877760428490368:12345-0@lo:103: 00010000:00010000:2.0:1790772005.643973:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772005.643992:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd55 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.644087:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772005.644132:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3294:x1877760428490368:12345-0@lo:103: Request processed in 171us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.644139:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772005.644231:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428490368:0@lo:103: 00000040:00080000:1.0:1790772005.644539:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790772005.644637:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790772005.644678:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790772005.645244:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790772005.645315:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790772005.645353:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790772005.645404:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490496:0@lo:502: 00000100:00100000:1.0:1790772005.645488:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.646691:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772005.647474:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428490496 00000100:00100000:3.0:1790772005.647488:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428490496 00000100:00100000:1.0:1790772005.647645:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790772005.647658:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:7610:x1877760428490496:12345-0@lo:502: 00000100:00100000:1.0:1790772005.651393:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:7610:x1877760428490496:12345-0@lo:502: Request processed in 3727us (5894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772005.651409:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790772005.651537:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490496:0@lo:502: 00000040:00080000:2.0:1790772005.651936:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790772005.651955:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1790772005.657354:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790772005.657370:0:7619:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790772005.657379:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772005.657382:0:7619:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790772005.657389:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790772005.657408:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8df259070000) 00000020:00000080:1.0:1790772005.657450:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790772005.657459:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790772005.657529:0:7619:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df273e99800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790772005.657539:0:7619:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790772005.657660:0:7619:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdf68d9a7d6a8fd78 00010000:00010000:1.0:1790772005.674344:0:7619:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1790772005.675167:0:7619:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1790772005.682979:0:7619:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790772005.683507:0:7619:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1790772005.697302:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1790772005.697975:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790772005.700687:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790772005.700704:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772005.700712:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772005.700714:0:7619:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790772005.700976:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772005.700983:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772005.700984:0:7619:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790772005.700989:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790772005.700991:0:7619:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790772005.701072:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772005.701077:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772005.701078:0:7619:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790772005.701082:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790772005.701402:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1790772005.701437:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790772005.701472:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.701486:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772005.701496:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df273e99800 from 1 10000000:01000000:3.0:1790772005.701498:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790772005.701568:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.701808:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.701825:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772005.701851:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490624:0@lo:101: 00000100:00100000:3.0:1790772005.701923:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772005.701965:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bb900 going to sleep for 11 seconds 00000100:00100000:0.0:1790772005.702835:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428490624 00000100:00100000:0.0:1790772005.702850:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428490624 00000100:00100000:0.0:1790772005.702901:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790772005.702911:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:7610:x1877760428490624:12345-0@lo:101: 00010000:00010000:0.0:1790772005.702929:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772005.702946:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a8fd86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fd7f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.702974:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a8fd86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd7f expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.702985:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a8fd86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd7f expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.702994:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030e00, rc 0) 00000100:00100000:0.0:1790772005.703061:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428490624:12345-0@lo:101: Request processed in 151us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772005.703068:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790772005.703130:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490624:0@lo:101: 00010000:00010000:0.0:1790772005.703147:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.703157:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772005.703287:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490752:0@lo:501: 00000100:00100000:0.0:1790772005.703327:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772005.703373:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25015f480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772005.703753:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428490752 00000100:00100000:3.0:1790772005.703758:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428490752 00000100:00100000:3.0:1790772005.703793:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790772005.703800:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428490752:12345-0@lo:501: 00000100:00100000:3.0:1790772005.704069:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428490752:12345-0@lo:501: Request processed in 268us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.704076:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790772005.704872:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490752:0@lo:501: 00000100:00100000:0.0:1790772005.704927:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490880:0@lo:503: 00000100:00100000:0.0:1790772005.704986:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772005.705027:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25015f480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772005.705471:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428490880 00000100:00100000:3.0:1790772005.705480:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428490880 00000100:00100000:3.0:1790772005.705534:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790772005.705863:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428490880:12345-0@lo:503: 00000100:00100000:3.0:1790772005.706283:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428490880:12345-0@lo:503: Request processed in 424us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.706292:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790772005.706655:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428490880:0@lo:503: 00000040:00080000:1.0:1790772005.707083:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790772005.707170:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491008:0@lo:502: 00000100:00100000:1.0:1790772005.707227:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.707266:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428491008 00000100:00100000:1.0:1790772005.707274:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428491008 00000100:00100000:1.0:1790772005.707312:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790772005.707321:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428491008:12345-0@lo:502: 00000100:00100000:1.0:1790772005.708106:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428491008:12345-0@lo:502: Request processed in 781us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772005.708117:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790772005.708191:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772005.708213:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491008:0@lo:502: 00000040:00080000:1.0:1790772005.708949:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790772005.709017:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790772005.709058:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491136:0@lo:502: 00000100:00100000:1.0:1790772005.709124:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772005.709217:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772005.709268:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428491136 00000100:00100000:3.0:1790772005.709276:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428491136 00000100:00100000:3.0:1790772005.709375:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790772005.709385:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428491136:12345-0@lo:502: 00000100:00100000:3.0:1790772005.709902:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428491136:12345-0@lo:502: Request processed in 335us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.709910:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790772005.710002:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491136:0@lo:502: 00000040:00080000:2.0:1790772005.710130:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790772005.710143:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790772005.711264:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772005.711280:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772005.711283:0:7623:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790772005.711291:0:7623:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df273e99800 00000020:00000080:3.0:1790772005.711294:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790772005.711317:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772005.711320:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772005.711321:0:7623:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790772005.711324:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790772005.711968:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790772005.711998:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790772005.712065:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.712079:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772005.712200:0:7610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790772005.712203:0:7610:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df273e99800 10000000:01000000:3.0:1790772005.712207:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df273e99800 10000000:01000000:3.0:1790772005.712222:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772005.712228:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df273e99800 from 1 10000000:01000000:3.0:1790772005.712231:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790772005.712277:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.712286:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.712297:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772005.712323:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491264:0@lo:101: 00000100:00100000:3.0:1790772005.712410:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772005.712467:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df248e83cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772005.712617:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428491264 00000100:00100000:2.0:1790772005.712626:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428491264 00000100:00100000:2.0:1790772005.712685:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790772005.712696:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428491264:12345-0@lo:101: 00010000:00010000:2.0:1790772005.712712:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772005.712738:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fd8d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.712764:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd8d expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.712775:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd8d expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.712790:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241391600, rc 0) 00000100:00100000:2.0:1790772005.712834:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:7610:x1877760428491264:12345-0@lo:101: Request processed in 140us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.712841:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790772005.713148:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491264:0@lo:101: 00010000:00010000:3.0:1790772005.713166:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772005.713174:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772005.713288:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491392:0@lo:501: 00000100:00100000:3.0:1790772005.713332:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772005.713376:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df248e83cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772005.713708:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428491392 00000100:00100000:2.0:1790772005.713833:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428491392 00000100:00100000:2.0:1790772005.713879:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790772005.713888:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:7610:x1877760428491392:12345-0@lo:501: 00000100:00100000:2.0:1790772005.714173:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:7610:x1877760428491392:12345-0@lo:501: Request processed in 285us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.714181:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790772005.714224:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491392:0@lo:501: 00000100:00100000:2.0:1790772005.714263:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491520:0@lo:503: 00000100:00100000:2.0:1790772005.714306:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772005.714331:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428491520 00000100:00100000:2.0:1790772005.714335:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428491520 00000100:00100000:2.0:1790772005.714358:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790772005.714372:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:7610:x1877760428491520:12345-0@lo:503: 00000100:00100000:2.0:1790772005.715864:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:7610:x1877760428491520:12345-0@lo:503: Request processed in 166us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.715883:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790772005.715957:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772005.715988:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491520:0@lo:503: 00000040:00080000:2.0:1790772005.716335:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772005.716464:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491648:0@lo:502: 00000100:00100000:2.0:1790772005.717042:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772005.717125:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25e310300 going to sleep for 11 seconds 00000100:00100000:3.0:1790772005.717178:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428491648 00000100:00100000:3.0:1790772005.717187:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428491648 00000100:00100000:3.0:1790772005.717285:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790772005.717298:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:7610:x1877760428491648:12345-0@lo:502: 00000100:00100000:3.0:1790772005.718030:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:7610:x1877760428491648:12345-0@lo:502: Request processed in 731us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.718042:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790772005.718066:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491648:0@lo:502: 00000040:00080000:0.0:1790772005.719302:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790772005.719409:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790772005.719626:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790772005.719697:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790772005.719752:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790772005.719806:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790772005.719845:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790772005.719882:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790772005.719936:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790772005.719975:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790772005.720009:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790772005.720059:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790772005.720093:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790772005.720124:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790772005.720171:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790772005.720222:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790772005.720259:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790772005.720321:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790772005.720821:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790772005.720863:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790772005.720917:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790772005.720952:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790772005.720982:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790772005.721036:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790772005.721070:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790772005.721103:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790772005.721153:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790772005.721191:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1790772005.721345:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790772005.721507:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1790772005.721544:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1790772005.721837:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1790772005.721877:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1790772005.721931:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1790772005.721985:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1790772005.722034:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1790772005.722070:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1790772005.722129:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491776:0@lo:502: 00000100:00100000:0.0:1790772005.723109:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772005.723174:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25015f480 going to sleep for 11 seconds 00000100:00100000:2.0:1790772005.723494:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428491776 00000100:00100000:2.0:1790772005.723505:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428491776 00000100:00100000:2.0:1790772005.723627:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790772005.723640:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:7610:x1877760428491776:12345-0@lo:502: 00000100:00100000:2.0:1790772005.724192:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:7610:x1877760428491776:12345-0@lo:502: Request processed in 553us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.724202:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790772005.724277:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428491776:0@lo:502: 00000040:00080000:0.0:1790772005.724408:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1790772005.724427:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1790772005.726034:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790772005.726054:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8df248b3cd40) 00000020:00000080:3.0:1790772005.726109:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1790772005.726188:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df273e99800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790772005.726193:0:7624:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df273e99800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790772005.726196:0:7624:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df273e99800 3 00010000:00080000:3.0:1790772005.726235:0:7624:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df27c040800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.127@tcp at head 00010000:00010000:3.0:1790772005.731096:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1790772005.731318:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790772005.731359:0:7624:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790772005.731451:0:7624:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdf68d9a7d6a8fda2 00000100:00080000:3.0:1790772005.731463:0:7624:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790772005.731476:0:7624:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df27c040800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1790772005.731518:0:7624:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27401d500 x1877760428491904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790772005.731686:0:7624:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790772005.734376:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1877760428491904:0@lo:38: 00000100:00100000:1.0:1790772005.734483:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772005.735061:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428491904 00000100:00100000:3.0:1790772005.735073:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428491904 00000100:00100000:3.0:1790772005.735129:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772005.735138:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3292:x1877760428491904:12345-0@lo:38: 00010000:00080000:3.0:1790772005.735177:0:5824:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:3.0:1790772005.735233:0:5824:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdf68d9a7d6a8fda9 00000004:00100000:3.0:1790772005.735253:0:5824:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790772005.735295:0:5824:0:(import.c:65:import_set_state_nolock()) ffff8df27c046000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772005.735381:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877760428491904:12345-0@lo:38: Request processed in 242us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.735388:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790772005.735846:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27401d500 x1877760428491904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772005.735860:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772005.735869:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1790772005.735877:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790772005.735882:0:3292:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790772005.735885:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df27c040800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790772005.735892:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1877760428491904:0@lo:38: 00000100:00100000:3.0:1790772005.736065:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772005.736128:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428492160:0@lo:400: 00000100:00100000:2.0:1790772005.736173:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772005.736198:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772005.736203:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428492288:0@lo:400: 00000100:00100000:2.0:1790772005.736228:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772005.736262:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428492160 00000100:00100000:2.0:1790772005.736267:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428492160 00000100:00100000:2.0:1790772005.736305:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772005.736311:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428492160:12345-0@lo:400: 00000100:00100000:2.0:1790772005.736355:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428492160:12345-0@lo:400: Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.736375:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772005.736398:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428492288 00000100:00100000:2.0:1790772005.736401:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428492288 00000100:00100000:2.0:1790772005.736424:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772005.736430:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428492288:12345-0@lo:400: 00000100:00100000:2.0:1790772005.736475:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428492288:12345-0@lo:400: Request processed in 45us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.736487:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790772005.736519:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab67800 x1877760428492288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772005.736530:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428492288:0@lo:400: 00010000:00080000:2.0:1790772005.736885:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab66680 x1877760428492160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772005.736896:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428492160:0@lo:400: 00000040:00080000:2.0:1790772005.737103:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1790772005.737169:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1790772005.737196:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1790772005.737273:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7626:1877760428492416:0@lo:901: 00000100:00100000:2.0:1790772005.737317:0:7626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772005.737351:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428492416 00000100:00100000:2.0:1790772005.737355:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428492416 00000100:00100000:2.0:1790772005.737407:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772005.737415:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1877760428492416:12345-0@lo:901: 00010000:00010000:0.0:1790772005.737465:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.737478:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790772005.737525:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790772005.737527:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790772005.737532:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772005.737533:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772005.737534:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772005.737535:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772005.737537:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790772005.737538:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772005.737540:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772005.737541:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772005.737543:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790772005.737859:0:7610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1790772005.737863:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790772005.737864:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790772005.737866:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772005.737867:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772005.737868:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772005.737869:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772005.737870:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790772005.737871:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772005.737872:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772005.737873:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772005.737874:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790772005.737891:0:7610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790772005.737903:0:7610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428492544:0@lo:253: 00000100:00100000:0.0:1790772005.737957:0:7610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772005.737987:0:7610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25015f480 going to sleep for 11 seconds 00000100:00100000:2.0:1790772005.738257:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1877760428492416:12345-0@lo:901: Request processed in 842us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.738267:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1790772005.738299:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772005.738310:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f8dbf00 going to sleep for 11 seconds 00010000:00080000:2.0:1790772005.738331:0:7626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab66680 x1877760428492416/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790772021 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772005.738342:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7626:1877760428492416:0@lo:901: 00000100:00100000:2.0:1790772005.738876:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428492544 00000100:00100000:2.0:1790772005.738884:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428492544 00000100:00100000:2.0:1790772005.738935:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790772005.738951:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:7610:x1877760428492544:12345-0@lo:253: 20000000:01000000:2.0:1790772005.738988:0:5816:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790772005.739004:0:5816:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1790772005.742482:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428492032:0@lo:400: 00000100:00100000:3.0:1790772005.742659:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772005.742706:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428492032 00000100:00100000:3.0:1790772005.742980:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428492032 00000100:00100000:3.0:1790772005.743040:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790772005.743050:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428492032:12345-0@lo:400: 00000100:00100000:3.0:1790772005.743116:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428492032:12345-0@lo:400: Request processed in 67us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772005.743124:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1790772005.743176:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ab67100 x1877760428492032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772005.743194:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428492032:0@lo:400: 20000000:01000000:3.0:1790772005.774117:0:5816:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790772005.774129:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1790772005.774205:0:5839:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790772005.774210:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790772005.774236:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.774259:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241391c00/0xdf68d9a7d6a8fd01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcfa expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.774268:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.774330:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241391c00/0xdf68d9a7d6a8fd01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcfa expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772005.774347:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241391c00/0xdf68d9a7d6a8fd01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcfa expref: 14 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772005.775230:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5839:1877760428492672:0@lo:104: 00000100:00100000:1.0:1790772005.775317:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772005.775474:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428492672 00000100:00100000:2.0:1790772005.775484:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428492672 00000100:00100000:2.0:1790772005.775567:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772005.775834:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a300 going to sleep for 11 seconds 00000100:00100000:2.0:1790772005.776210:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:5839:x1877760428492672:12345-0@lo:104: 00010000:00010000:2.0:1790772005.776232:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.776324:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772005.776331:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:5839:x1877760428492672:12345-0@lo:104: Request processed in 755us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.776339:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790772005.776877:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5839:1877760428492672:0@lo:104: 00010000:00010000:3.0:1790772005.776908:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.776980:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772005.776987:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.776995:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df28204f000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772005.777001:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.777011:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772005.777020:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772005.777026:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772005.777086:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.777093:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772005.777114:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.777122:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df28204f000/0xdf68d9a7d6a8fcfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd01 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.777141:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772005.777142:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772005.777144:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772005.777158:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428492800:0@lo:103: 00000100:00100000:2.0:1790772005.777204:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772005.777254:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428492800 00000100:00100000:2.0:1790772005.777260:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428492800 00010000:00010000:2.0:1790772005.777284:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241391c00/0xdf68d9a7d6a8fd01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcfa expref: 15 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772005.777306:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772005.777314:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:3293:x1877760428492800:12345-0@lo:103: 00010000:00010000:2.0:1790772005.777327:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772005.777332:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241391c00/0xdf68d9a7d6a8fd01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcfa expref: 15 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.777343:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241391c00/0xdf68d9a7d6a8fd01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcfa expref: 15 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.777356:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241391c00/0xdf68d9a7d6a8fd01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcfa expref: 15 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.779502:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.779514:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790772005.779546:0:5809:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005336699s 00010000:00010000:2.0:1790772005.779567:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.779574:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.779589:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.779597:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.779604:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772005.779609:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.779618:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.779643:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772005.779655:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772005.779777:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:3293:x1877760428492800:12345-0@lo:103: Request processed in 2459us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772005.779788:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772005.779894:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428492800:0@lo:103: 00010000:00010000:0.0:1790772005.780523:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.780535:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772005.780543:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b9400/0xdf68d9a7d6a8fdb0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772005.787909:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:7610:x1877760428492544:12345-0@lo:253: Request processed in 48943us (49935us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772005.787926:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790772005.788235:0:7610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f9eb452-8c57-4388-9743-b6ab49eaf81d:7610:1877760428492544:0@lo:253: 10000000:01000000:0.0:1790772005.788255:0:7610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790772005.788272:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790772005.788274:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790772005.788276:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772005.788277:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772005.788279:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772005.788280:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772005.788282:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790772005.788284:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772005.788285:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772005.788287:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772005.788288:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790772005.788306:0:7610:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790772005.800996:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772005.801210:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790772005.802023:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772005.802261:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790772005.803912:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772005.804252:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790772005.806135:0:7610:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1790772005.926863:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790772006.000220:0:7610:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790772006.000229:0:7610:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790772006.000271:0:7610:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790772006.000339:0:7610:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790772006.000357:0:7610:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790772006.000388:0:7610:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1790772006.944952:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772007.969702:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772008.992344:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772009.441111:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428492928:0@lo:13: 00000100:00100000:1.0:1790772009.441192:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772009.441296:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428492928 00000100:00100000:2.0:1790772009.441304:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428492928 00000100:00100000:2.0:1790772009.441371:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772009.441380:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428492928:12345-0@lo:13: 00002000:00000024:2.0:1790772009.441414:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772009.441484:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428492928:12345-0@lo:13: Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772009.441492:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790772009.441858:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790772009.441890:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27ab66680 x1877760428492928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772009.441910:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428492928:0@lo:13: 00010000:00010000:0.0:1790772010.015973:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772010.981130:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428493312:0@lo:400: 00000100:00100000:3.0:1790772010.981216:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772010.981280:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772010.981287:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428493440:0@lo:400: 00000100:00100000:3.0:1790772010.981333:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772010.981373:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428493440 00000100:00100000:3.0:1790772010.981383:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428493440 00000100:00100000:3.0:1790772010.981449:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772010.981461:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428493440:12345-0@lo:400: 00000100:00100000:3.0:1790772010.981522:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428493440:12345-0@lo:400: Request processed in 63us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772010.981530:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790772010.981610:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27401c000 x1877760428493440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772010.981627:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428493440:0@lo:400: 00000100:00100000:0.0:1790772010.981835:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428493056:0@lo:400: 00000100:00100000:0.0:1790772010.981890:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772010.981925:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428493568:0@lo:400: 00000100:00100000:0.0:1790772010.981956:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772010.981974:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772010.981981:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428493184:0@lo:400: 00000100:00100000:0.0:1790772010.982003:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772010.982033:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428493312 00000100:00100000:0.0:1790772010.982038:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428493312 00000100:00100000:0.0:1790772010.982080:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428493568 00000100:00100000:0.0:1790772010.982083:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428493568 00000100:00100000:0.0:1790772010.982126:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428493184 00000100:00100000:0.0:1790772010.982129:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428493184 00000100:00100000:0.0:1790772010.982144:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790772010.982151:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428493312:12345-0@lo:400: 00000100:00100000:0.0:1790772010.982191:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428493312:12345-0@lo:400: Request processed in 40us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772010.982198:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790772010.982213:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790772010.982219:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428493568:12345-0@lo:400: 00000100:00100000:0.0:1790772010.982251:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428493568:12345-0@lo:400: Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772010.982257:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790772010.982269:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790772010.982274:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428493184:12345-0@lo:400: 00000100:00100000:0.0:1790772010.982300:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428493184:12345-0@lo:400: Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772010.982306:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1790772010.982332:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27401d500 x1877760428493184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772010.982342:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428493184:0@lo:400: 00010000:00080000:0.0:1790772010.982353:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27401ed80 x1877760428493568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772010.982361:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428493568:0@lo:400: 00000100:00080000:1.0:1790772010.982515:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772010.984325:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428493056 00000100:00100000:3.0:1790772010.984343:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428493056 00000100:00100000:3.0:1790772010.984423:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790772010.984435:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:3295:x1877760428493056:12345-0@lo:400: 00000100:00100000:3.0:1790772010.984534:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:3295:x1877760428493056:12345-0@lo:400: Request processed in 103us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772010.984541:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790772010.984627:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428493056:0@lo:400: 00010000:00080000:3.0:1790772010.984667:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27401dc00 x1877760428493312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772010.984708:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428493312:0@lo:400: 00010000:00010000:2.0:1790772011.039945:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772012.064658:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772013.095110:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772013.147248:0:7968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790772014.111764:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772014.560276:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772014.560319:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428493696:0@lo:13: 00000100:00100000:0.0:1790772014.560411:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1790772014.560641:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790772014.560645:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df242cf1800 from 30 10000000:01000000:0.0:1790772014.560649:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790772014.560687:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.560698:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.560710:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772014.560728:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428493824:0@lo:101: 00000100:00100000:0.0:1790772014.560761:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772014.560786:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2437e6180 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.560894:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428493824 00000100:00100000:0.0:1790772014.560904:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428493824 00000100:00100000:0.0:1790772014.560968:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790772014.560977:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428493824:12345-0@lo:101: 00010000:00010000:0.0:1790772014.560996:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772014.561021:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fdbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fdb7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.561060:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fdbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdb7 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.561073:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fdbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdb7 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772014.561078:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428493696 00000100:00100000:1.0:1790772014.561085:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428493696 00010000:00010000:0.0:1790772014.561099:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031200, rc 0) 00000100:00100000:1.0:1790772014.561140:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772014.561149:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428493824:12345-0@lo:101: Request processed in 171us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772014.561154:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428493696:12345-0@lo:13: 00000100:00100000:0.0:1790772014.561160:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790772014.561213:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428493824:0@lo:101: 00010000:00010000:0.0:1790772014.561232:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.561243:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:1.0:1790772014.561254:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772014.561310:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428493952:0@lo:501: 00000100:00100000:1.0:1790772014.561319:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428493696:12345-0@lo:13: Request processed in 170us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772014.561337:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772014.561343:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772014.561361:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.561375:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428493952 00000100:00100000:0.0:1790772014.561378:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428493952 00000100:00100000:0.0:1790772014.561413:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790772014.561420:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428493952:12345-0@lo:501: 00000100:00080000:1.0:1790772014.561444:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772014.561923:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428493952:12345-0@lo:501: Request processed in 501us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.561932:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790772014.561975:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428493952:0@lo:501: 00000100:00100000:0.0:1790772014.562027:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428494080:0@lo:503: 00000100:00100000:0.0:1790772014.562087:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772014.562110:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.562128:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428494080 00000100:00100000:0.0:1790772014.562132:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428494080 00000100:00100000:0.0:1790772014.562156:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790772014.562162:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428494080:12345-0@lo:503: 00000100:00100000:0.0:1790772014.562454:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428494080:12345-0@lo:503: Request processed in 291us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.562462:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790772014.562502:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428494080:0@lo:503: 00000100:00100000:0.0:1790772014.562709:0:8038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8038:1877760428494208:0@lo:502: 00000100:00100000:0.0:1790772014.562750:0:8038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772014.562771:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428494208 00000100:00100000:0.0:1790772014.562776:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428494208 00000100:00100000:0.0:1790772014.562813:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790772014.562820:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:8038:x1877760428494208:12345-0@lo:502: 00000100:00100000:0.0:1790772014.563030:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:8038:x1877760428494208:12345-0@lo:502: Request processed in 209us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.563038:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790772014.563074:0:8038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df252011480 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.563087:0:8038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8038:1877760428494208:0@lo:502: 00000100:00100000:0.0:1790772014.563127:0:8038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8038:1877760428494336:0@lo:502: 00000100:00100000:0.0:1790772014.563162:0:8038:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772014.563187:0:8038:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df252011480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772014.563272:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428494336 00000100:00100000:3.0:1790772014.563277:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428494336 00000100:00100000:3.0:1790772014.563310:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790772014.563317:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:8038:x1877760428494336:12345-0@lo:502: 00000100:00100000:3.0:1790772014.563539:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:8038:x1877760428494336:12345-0@lo:502: Request processed in 221us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772014.563545:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790772014.563728:0:8038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8038:1877760428494336:0@lo:502: 00000040:00080000:0.0:1790772014.563749:0:8038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790772014.564260:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790772014.564286:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790772014.564298:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.564310:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772014.564326:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790772014.564329:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1790772014.564331:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790772014.564366:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.564375:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.564385:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772014.564426:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e304380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428494464:0@lo:101: 00000100:00100000:3.0:1790772014.565849:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772014.565904:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc840 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.566106:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428494464 00000100:00100000:0.0:1790772014.566116:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428494464 00000100:00100000:0.0:1790772014.566188:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790772014.566198:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428494464:12345-0@lo:101: 00010000:00010000:0.0:1790772014.566217:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772014.566236:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240030200/0xdf68d9a7d6a8fdcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fdc5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.566268:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240030200/0xdf68d9a7d6a8fdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdc5 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.566281:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240030200/0xdf68d9a7d6a8fdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdc5 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.566291:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030200, rc 0) 00000100:00100000:0.0:1790772014.566349:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428494464:12345-0@lo:101: Request processed in 152us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.566357:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790772014.566656:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e304380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428494464:0@lo:101: 00010000:00080000:1.0:1790772014.566990:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e87b80 x1877760428493696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772014.567010:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428493696:0@lo:13: 00010000:00010000:3.0:1790772014.567830:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.567848:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772014.567950:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e304380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428494592:0@lo:501: 00000100:00100000:3.0:1790772014.568014:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772014.568061:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc840 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.568313:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428494592 00000100:00100000:0.0:1790772014.568321:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428494592 00000100:00100000:0.0:1790772014.568366:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790772014.568376:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428494592:12345-0@lo:501: 00000100:00100000:0.0:1790772014.568725:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428494592:12345-0@lo:501: Request processed in 347us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.568733:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790772014.568873:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e304380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428494592:0@lo:501: 00000100:00100000:1.0:1790772014.568922:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428494720:0@lo:503: 00000100:00100000:1.0:1790772014.568972:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.569001:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247d6b180 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.569336:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428494720 00000100:00100000:0.0:1790772014.569342:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428494720 00000100:00100000:0.0:1790772014.569384:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790772014.569402:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428494720:12345-0@lo:503: 00000100:00100000:0.0:1790772014.569761:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428494720:12345-0@lo:503: Request processed in 369us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.569775:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790772014.570048:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428494720:0@lo:503: 00000100:00100000:3.0:1790772014.570785:0:8039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8039:1877760428494848:0@lo:502: 00000100:00100000:3.0:1790772014.570847:0:8039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772014.570890:0:8039:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc240 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.570956:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428494848 00000100:00100000:0.0:1790772014.570963:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428494848 00000100:00100000:0.0:1790772014.570998:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790772014.571006:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:8039:x1877760428494848:12345-0@lo:502: 00000100:00100000:0.0:1790772014.571263:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:8039:x1877760428494848:12345-0@lo:502: Request processed in 255us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.571271:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790772014.571427:0:8039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8039:1877760428494848:0@lo:502: 00000020:01000000:3.0:1790772014.571464:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772014.571476:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772014.571478:0:8039:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790772014.571485:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790772014.571487:0:8039:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790772014.571504:0:8039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8039:1877760428494976:0@lo:502: 00000100:00100000:3.0:1790772014.571539:0:8039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772014.571594:0:8039:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc240 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.571764:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428494976 00000100:00100000:0.0:1790772014.571770:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428494976 00000100:00100000:0.0:1790772014.571805:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790772014.571813:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:8039:x1877760428494976:12345-0@lo:502: 00000100:00100000:0.0:1790772014.571953:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:8039:x1877760428494976:12345-0@lo:502: Request processed in 139us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.571960:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790772014.572256:0:8039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8039:1877760428494976:0@lo:502: 00000020:01000000:3.0:1790772014.572278:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772014.572283:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772014.572285:0:8039:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790772014.572290:0:8039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1790772014.572478:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790772014.572506:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790772014.572519:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772014.572532:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772014.572542:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790772014.572545:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df258965000 from 30 10000000:01000000:1.0:1790772014.572758:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790772014.572790:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772014.572799:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772014.572810:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772014.572836:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428495104:0@lo:101: 00000100:00100000:1.0:1790772014.572880:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.572913:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247d6bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.572991:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428495104 00000100:00100000:0.0:1790772014.572998:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428495104 00000100:00100000:0.0:1790772014.573039:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790772014.573048:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428495104:12345-0@lo:101: 00010000:00010000:0.0:1790772014.573060:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772014.573074:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240030a00/0xdf68d9a7d6a8fdda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fdd3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.573100:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240030a00/0xdf68d9a7d6a8fdda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdd3 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.573113:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240030a00/0xdf68d9a7d6a8fdda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdd3 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772014.573130:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030a00, rc 0) 00000100:00100000:0.0:1790772014.573177:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428495104:12345-0@lo:101: Request processed in 130us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.573183:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790772014.573275:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428495104:0@lo:101: 00010000:00010000:2.0:1790772014.573290:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772014.573298:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772014.573350:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428495232:0@lo:501: 00000100:00100000:2.0:1790772014.573377:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772014.573416:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.573534:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428495232 00000100:00100000:0.0:1790772014.573538:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428495232 00000100:00100000:0.0:1790772014.573596:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790772014.573603:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428495232:12345-0@lo:501: 00000100:00100000:0.0:1790772014.577857:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428495232:12345-0@lo:501: Request processed in 4242us (4467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.577874:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790772014.578265:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428495232:0@lo:501: 00000100:00100000:2.0:1790772014.578331:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428495360:0@lo:503: 00000100:00100000:2.0:1790772014.578376:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772014.578426:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772014.578427:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428495360 00000100:00100000:1.0:1790772014.578435:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428495360 00000100:00100000:1.0:1790772014.578502:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790772014.578512:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428495360:12345-0@lo:503: 00000100:00100000:0.0:1790772014.585406:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428495360:12345-0@lo:503: Request processed in 6870us (7004us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.585425:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790772014.588080:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428495360:0@lo:503: 00000100:00100000:1.0:1790772014.588575:0:8041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8041:1877760428495488:0@lo:502: 00000100:00100000:1.0:1790772014.588665:0:8041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.588704:0:8041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247d6b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.588865:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428495488 00000100:00100000:0.0:1790772014.588874:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428495488 00000100:00100000:0.0:1790772014.589028:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790772014.589041:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:8041:x1877760428495488:12345-0@lo:502: 00000100:00100000:0.0:1790772014.589497:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:8041:x1877760428495488:12345-0@lo:502: Request processed in 457us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.589507:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790772014.589811:0:8041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8041:1877760428495488:0@lo:502: 00000100:00100000:3.0:1790772014.589875:0:8041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8041:1877760428495616:0@lo:502: 00000100:00100000:3.0:1790772014.589919:0:8041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772014.589958:0:8041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc540 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.590056:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428495616 00000100:00100000:0.0:1790772014.590063:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428495616 00000100:00100000:0.0:1790772014.590108:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790772014.590119:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:8041:x1877760428495616:12345-0@lo:502: 00000100:00100000:0.0:1790772014.590430:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:8041:x1877760428495616:12345-0@lo:502: Request processed in 305us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.590447:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790772014.592915:0:8041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8041:1877760428495616:0@lo:502: 00000040:00080000:3.0:1790772014.592972:0:8041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790772014.593274:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790772014.593307:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790772014.593322:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772014.593334:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772014.593343:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790772014.593347:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df258965000 from 5 10000000:01000000:2.0:1790772014.593350:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790772014.593407:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772014.593416:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772014.593426:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772014.593447:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428495744:0@lo:101: 00000100:00100000:2.0:1790772014.593522:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772014.593602:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772014.594343:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428495744 00000100:00100000:3.0:1790772014.594353:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428495744 00000100:00100000:3.0:1790772014.594416:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790772014.594427:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428495744:12345-0@lo:101: 00010000:00010000:3.0:1790772014.594444:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772014.594474:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2414a2000/0xdf68d9a7d6a8fde8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fde1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.594504:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2414a2000/0xdf68d9a7d6a8fde8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fde1 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.594515:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2414a2000/0xdf68d9a7d6a8fde8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fde1 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.594525:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2000, rc 0) 00000100:00100000:3.0:1790772014.594601:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428495744:12345-0@lo:101: Request processed in 176us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772014.594617:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428495744:0@lo:101: 00000100:00100000:3.0:1790772014.594620:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00010000:2.0:1790772014.594643:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772014.594663:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772014.594723:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428495872:0@lo:256: 00000100:00100000:2.0:1790772014.594762:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772014.594787:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428495872 00000100:00100000:0.0:1790772014.594793:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428495872 00000100:00100000:2.0:1790772014.594800:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.594831:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790772014.594841:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428495872:12345-0@lo:256: 20000000:01000000:0.0:1790772014.594859:0:5818:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790772014.594879:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790772014.594883:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1790772014.595298:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428495872:12345-0@lo:256: Request processed in 457us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.595306:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790772014.595883:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428495872:0@lo:256: 10000000:01000000:2.0:1790772014.595935:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790772014.595945:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772014.595954:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772014.595963:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790772014.595965:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1790772014.595969:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790772014.595996:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772014.596004:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772014.596013:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772014.596029:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428496000:0@lo:101: 00000100:00100000:2.0:1790772014.596077:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772014.596116:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772014.596168:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428496000 00000100:00100000:3.0:1790772014.596174:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428496000 00000100:00100000:3.0:1790772014.596219:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790772014.596228:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428496000:12345-0@lo:101: 00010000:00010000:3.0:1790772014.596241:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772014.596255:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8fdf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fdef expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.596278:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8fdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdef expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.596288:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8fdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdef expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.596295:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2400, rc 0) 00000100:00100000:3.0:1790772014.596342:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428496000:12345-0@lo:101: Request processed in 115us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772014.596349:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790772014.596426:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428496000:0@lo:101: 00010000:00010000:1.0:1790772014.596441:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772014.596449:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772014.596506:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428496128:0@lo:501: 00000100:00100000:1.0:1790772014.596538:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.596588:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247d6b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790772014.596722:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428496128 00000100:00100000:2.0:1790772014.596727:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428496128 00000100:00100000:2.0:1790772014.596762:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790772014.596769:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428496128:12345-0@lo:501: 00000100:00100000:2.0:1790772014.597066:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428496128:12345-0@lo:501: Request processed in 297us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772014.597074:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790772014.597143:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428496128:0@lo:501: 00000100:00100000:1.0:1790772014.597175:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428496256:0@lo:503: 00000100:00100000:1.0:1790772014.597214:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.597244:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247d6b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790772014.597261:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428496256 00000100:00100000:1.0:1790772014.597265:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428496256 00000100:00100000:1.0:1790772014.597289:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790772014.597297:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428496256:12345-0@lo:503: 00000100:00100000:1.0:1790772014.600109:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428496256:12345-0@lo:503: Request processed in 2801us (2881us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772014.600126:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790772014.601488:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428496256:0@lo:503: 00000100:00100000:2.0:1790772014.604101:0:8043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab64000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8043:1877760428496384:0@lo:502: 00000100:00100000:2.0:1790772014.604234:0:8043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772014.604286:0:8043:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772014.604415:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428496384 00000100:00100000:3.0:1790772014.604425:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428496384 00000100:00100000:3.0:1790772014.604486:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790772014.604496:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8043:x1877760428496384:12345-0@lo:502: 00000100:00100000:3.0:1790772014.606327:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8043:x1877760428496384:12345-0@lo:502: Request processed in 1822us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772014.606343:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790772014.607971:0:8043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab64000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8043:1877760428496384:0@lo:502: 00000020:01000000:2.0:1790772014.608028:0:8043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790772014.608038:0:8043:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790772014.608049:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772014.608052:0:8043:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790772014.608059:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790772014.608064:0:8043:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.127@tcp to nid 0x20000c0a8ce7f (192.168.206.127@tcp) 00000020:01000000:2.0:1790772014.608094:0:8043:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790772014.608097:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790772014.608115:0:8043:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8df27fad0000) 00000020:00000080:2.0:1790772014.608143:0:8043:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790772014.608149:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790772014.608243:0:8043:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790772014.608250:0:8043:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790772014.608280:0:8043:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a8fe04 00010000:00080000:2.0:1790772014.608316:0:8043:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df248b50000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:2.0:1790772014.608620:0:8043:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1790772014.609188:0:8043:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790772014.609205:0:8043:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790772014.611129:0:8043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772014.611381:0:8043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772014.611450:0:8043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790772014.611519:0:8043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790772014.619335:0:8044:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772014.619344:0:8044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790772014.620193:0:8043:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772014.620210:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790772014.620250:0:8043:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790772014.620276:0:8043:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf68d9a7d6a8fe0b 00000100:00080000:1.0:1790772014.620290:0:8043:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772014.620315:0:8043:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df248b50000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1790772014.620361:0:8043:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df258e86300 x1877760428496512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772014.620391:0:8043:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790772014.620485:0:8043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772014.620490:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772014.620492:0:8043:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790772014.620495:0:8043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772014.620500:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772014.620501:0:8043:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790772014.620504:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790772014.620507:0:8043:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790772014.620541:0:8043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8043:1877760428496640:0@lo:502: 00000100:00100000:1.0:1790772014.620706:0:8043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.620748:0:8043:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247d6b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772014.620835:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772014.620873:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428496768:0@lo:400: 00000100:00100000:3.0:1790772014.620919:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772014.620953:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772014.620959:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428496896:0@lo:400: 00000100:00100000:3.0:1790772014.620981:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772014.621016:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428496768 00000100:00100000:3.0:1790772014.621025:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428496768 00000100:00100000:2.0:1790772014.621051:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428496512:0@lo:8: 00000100:00100000:3.0:1790772014.621071:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428496896 00000100:00100000:3.0:1790772014.621076:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428496896 00000100:00100000:2.0:1790772014.621112:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772014.621119:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772014.621130:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428496768:12345-0@lo:400: 00000100:00100000:2.0:1790772014.621149:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428496512 00000100:00100000:2.0:1790772014.621155:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428496512 00000100:00100000:2.0:1790772014.621182:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772014.621190:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1877760428496512:12345-0@lo:8: 00000100:00100000:3.0:1790772014.621198:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428496768:12345-0@lo:400: Request processed in 67us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772014.621206:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1790772014.621220:0:6678:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000100:00100000:3.0:1790772014.621228:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772014.621237:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428496896:12345-0@lo:400: 00000020:00000080:2.0:1790772014.621259:0:6678:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf68d9a7d6a8fe12 00000100:00100000:3.0:1790772014.621269:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428496896:12345-0@lo:400: Request processed in 34us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772014.621276:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00002000:00100000:2.0:1790772014.621279:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8df248b57800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790772014.621285:0:6678:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1790772014.621290:0:6678:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1790772014.621298:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790772014.621336:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25e306d80 x1877760428496896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772014.621350:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428496896:0@lo:400: 00010000:00080000:3.0:1790772014.621363:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25e305180 x1877760428496768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772014.621371:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428496768:0@lo:400: 00000100:00100000:3.0:1790772014.621433:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428496640 00000100:00100000:3.0:1790772014.621445:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428496640 00002000:00100000:2.0:1790772014.621467:0:6678:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1790772014.621489:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790772014.621498:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8043:x1877760428496640:12345-0@lo:502: 00002000:00080000:2.0:1790772014.621705:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790772014.621733:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8df248b52800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772014.621779:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1877760428496512:12345-0@lo:8: Request processed in 589us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772014.621785:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790772014.621823:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e86300 x1877760428496512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772014.621831:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790772014.621838:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790772014.621846:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790772014.621851:0:3292:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790772014.621853:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df248b50000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790772014.621867:0:3292:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790772014.621872:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428496512:0@lo:8: 00000004:00080000:2.0:1790772014.621893:0:8044:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790772014.622023:0:8044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 180766472410ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790772014.622060:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8043:x1877760428496640:12345-0@lo:502: Request processed in 562us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772014.622069:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790772014.622947:0:8043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8043:1877760428496640:0@lo:502: 00000020:01000000:1.0:1790772014.623007:0:8043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772014.623016:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772014.623018:0:8043:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790772014.623024:0:8043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1790772014.623127:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1790772014.623148:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790772014.623161:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772014.623173:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772014.623183:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790772014.623186:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df258e04d40 from 1 10000000:01000000:1.0:1790772014.623189:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790772014.623226:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772014.623235:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772014.623245:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772014.623265:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428497152:0@lo:101: 00000100:00100000:1.0:1790772014.623318:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.623359:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247d6b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772014.623854:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428497152 00000100:00100000:3.0:1790772014.623864:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428497152 00000100:00100000:3.0:1790772014.623910:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790772014.623919:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428497152:12345-0@lo:101: 00010000:00010000:3.0:1790772014.623935:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772014.623956:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fe20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fe19 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.623986:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fe20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe19 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.623997:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fe20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe19 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.624006:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2e00, rc 0) 00000100:00100000:3.0:1790772014.624134:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428497152:12345-0@lo:101: Request processed in 216us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772014.624141:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790772014.626406:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428497152:0@lo:101: 00010000:00010000:3.0:1790772014.626445:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.626473:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772014.627088:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428497280:0@lo:501: 00000100:00100000:3.0:1790772014.627157:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772014.627200:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772014.627224:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428497280 00000100:00100000:3.0:1790772014.627231:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428497280 00000100:00100000:3.0:1790772014.627271:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790772014.627281:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428497280:12345-0@lo:501: 00000100:00100000:3.0:1790772014.627840:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428497280:12345-0@lo:501: Request processed in 557us (680us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790772014.627849:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790772014.627903:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428497280:0@lo:501: 10000000:01000000:3.0:1790772014.627936:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790772014.627946:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772014.627958:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772014.632308:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428497024:0@lo:400: 00000100:00100000:0.0:1790772014.632391:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772014.632609:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428497024 00000100:00100000:2.0:1790772014.632620:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428497024 00000100:00100000:2.0:1790772014.632707:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790772014.632718:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428497024:12345-0@lo:400: 00000100:00100000:2.0:1790772014.632793:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428497024:12345-0@lo:400: Request processed in 76us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772014.632800:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1790772014.632975:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25e305880 x1877760428497024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772014.632992:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428497024:0@lo:400: 00000100:00080000:1.0:1790772014.634019:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1790772014.710881:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1790772014.752011:0:8045:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790772014.752057:0:8045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8045:1877760428497536:0@lo:7: 00000100:00100000:1.0:1790772014.752158:0:8045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.752216:0:8045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2499a0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772014.752249:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772014.752262:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428497408:0@lo:13: 00000100:00100000:1.0:1790772014.752288:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.752321:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428497536 00000100:00100000:1.0:1790772014.752330:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428497536 00000100:00100000:1.0:1790772014.752403:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790772014.752414:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8045:x1877760428497536:12345-0@lo:7: 00000100:00100000:3.0:1790772014.753851:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428497408 00000100:00100000:3.0:1790772014.753864:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428497408 00000100:00100000:3.0:1790772014.753923:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790772014.753933:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428497408:12345-0@lo:13: 00002000:00000024:3.0:1790772014.753966:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1790772014.754051:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428497408:12345-0@lo:13: Request processed in 119us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772014.754058:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1790772014.754649:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790772014.754702:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e87100 x1877760428497408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772014.754724:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428497408:0@lo:13: 00002000:00080000:0.0:1790772014.760993:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1790772014.761004:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790772014.761159:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8045:x1877760428497536:12345-0@lo:7: Request processed in 8741us (8995us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772014.761172:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790772014.761272:0:8045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e86d80 x1877760428497536/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790772030 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772014.761289:0:8045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8045:1877760428497536:0@lo:7: 00000004:00080000:1.0:1790772014.761306:0:8045:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790772014.761359:0:8045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8045:1877760428497664:0@lo:5: 00000100:00100000:1.0:1790772014.761411:0:8045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.761505:0:8045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df248e833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772014.761900:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428497664 00000100:00100000:2.0:1790772014.761909:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428497664 00000100:00100000:2.0:1790772014.761994:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772014.762005:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8045:x1877760428497664:12345-0@lo:5: 00002000:00080000:2.0:1790772014.762036:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790772014.762040:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790772014.762417:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8045:x1877760428497664:12345-0@lo:5: Request processed in 413us (1004us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790772014.762426:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790772014.762504:0:8045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e86d80 x1877760428497664/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772030 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772014.762519:0:8045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8045:1877760428497664:0@lo:5: 00000004:00080000:1.0:1790772014.762530:0:8045:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790772014.762745:0:8045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8045:1877760428497792:0@lo:700: 00000100:00100000:1.0:1790772014.762778:0:8045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772014.762811:0:8045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df248e833c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772014.762943:0:6685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428497792 00000100:00100000:3.0:1790772014.762949:0:6685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428497792 00000100:00100000:3.0:1790772014.762994:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790772014.763004:0:6685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8045:x1877760428497792:12345-0@lo:700: 00000100:00100000:3.0:1790772014.763038:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1877760428497920:0@lo:700: 00000100:00100000:3.0:1790772014.763072:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772014.763101:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2464a00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772014.763115:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428497920 00000100:00100000:3.0:1790772014.763118:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428497920 00000100:00100000:3.0:1790772014.763145:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790772014.763152:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1877760428497920:12345-0@lo:700: 40000000:02000000:3.0:1790772014.823269:0:5830:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1790772014.832331:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1877760428497920:12345-0@lo:700: Request processed in 69167us (69245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772014.832349:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790772014.833642:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25e305180 x1877760428497920/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790772030 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772014.833806:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1877760428497920:0@lo:700: 40000000:02000000:1.0:1790772014.833826:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1790772014.968131:0:6685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8045:x1877760428497792:12345-0@lo:700: Request processed in 205116us (205339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772014.968149:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790772014.968325:0:8045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e87480 x1877760428497792/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790772030 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772014.968343:0:8045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8045:1877760428497792:0@lo:700: 00000001:00080000:2.0:1790772014.969345:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1790772014.969357:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1790772015.006137:0:8045:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1790772015.012406:0:8045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8045:1877760428498048:0@lo:5: 00000100:00100000:3.0:1790772015.012493:0:8045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772015.012579:0:8045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2464a0480 going to sleep for 11 seconds 00000100:00100000:0.0:1790772015.012909:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428498048 00000100:00100000:0.0:1790772015.012920:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428498048 00000100:00100000:0.0:1790772015.012986:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772015.012997:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8045:x1877760428498048:12345-0@lo:5: 00002000:00080000:1.0:1790772015.022921:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1790772015.022946:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1790772015.031002:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8045:x1877760428498048:12345-0@lo:5: Request processed in 17993us (18496us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790772015.031018:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790772015.031087:0:8045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25e305500 x1877760428498048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772031 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772015.031102:0:8045:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790772015.031121:0:8045:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8df25e305500 x1877760428498048/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790772031 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772015.031134:0:8045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8045:1877760428498048:0@lo:5: 00000004:00080000:1.0:1790772015.031151:0:8045:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1790772015.135704:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772016.159861:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772017.184318:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772018.215962:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790772018.317271:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1790772019.231824:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772019.682045:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428498432:0@lo:400: 00000100:00100000:1.0:1790772019.682075:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428498560:0@lo:400: 00000100:00100000:0.0:1790772019.682124:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772019.682157:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772019.682211:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428498560 00000100:00100000:0.0:1790772019.682221:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428498560 00000100:00100000:0.0:1790772019.682288:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772019.682296:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428498560:12345-0@lo:400: 00000100:00100000:0.0:1790772019.682348:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428498560:12345-0@lo:400: Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772019.682355:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790772019.682886:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790772019.682925:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e87b80 x1877760428498560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772019.682940:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428498560:0@lo:400: 00000100:00100000:3.0:1790772019.683684:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428498176:0@lo:400: 00000100:00100000:3.0:1790772019.683736:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772019.683797:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428498688:0@lo:400: 00000100:00100000:3.0:1790772019.683826:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772019.683831:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428498944:0@lo:13: 00000100:00100000:3.0:1790772019.683854:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790772019.683863:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428498304:0@lo:400: 00000100:00100000:0.0:1790772019.683870:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772019.683897:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772019.683922:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428498816:0@lo:400: 00000100:00100000:3.0:1790772019.683947:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772019.683950:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428498176 00000100:00100000:0.0:1790772019.683959:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428498176 00000100:00100000:3.0:1790772019.683977:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428498432 00000100:00100000:3.0:1790772019.683984:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428498432 00000100:00100000:0.0:1790772019.684005:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790772019.684016:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428498176:12345-0@lo:400: 00000100:00100000:3.0:1790772019.684027:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428498688 00000100:00100000:3.0:1790772019.684031:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428498688 00000100:00100000:3.0:1790772019.684053:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428498304 00000100:00100000:3.0:1790772019.684056:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428498304 00000100:00100000:0.0:1790772019.684074:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428498176:12345-0@lo:400: Request processed in 60us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772019.684077:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790772019.684087:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790772019.684092:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428498432:12345-0@lo:400: 00000100:00100000:0.0:1790772019.684139:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428498816 00000100:00100000:0.0:1790772019.684143:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428498816 00000100:00100000:3.0:1790772019.684156:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428498432:12345-0@lo:400: Request processed in 68us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772019.684174:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790772019.684177:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772019.684187:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428498816:12345-0@lo:400: 00000100:00100000:3.0:1790772019.684198:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790772019.684208:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428498688:12345-0@lo:400: 00000100:00100000:0.0:1790772019.684232:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428498816:12345-0@lo:400: Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772019.684240:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790772019.684253:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428498688:12345-0@lo:400: Request processed in 45us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772019.684262:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790772019.684268:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790772019.684278:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428498304:12345-0@lo:400: 00000100:00100000:3.0:1790772019.684288:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428498944 00000100:00100000:3.0:1790772019.684293:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428498944 00000100:00100000:0.0:1790772019.684314:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428498304:12345-0@lo:400: Request processed in 38us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772019.684321:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790772019.684327:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790772019.684337:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428498944:12345-0@lo:13: 00002000:00000024:3.0:1790772019.684381:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790772019.684395:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772019.684401:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790772019.684436:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e86300 x1877760428498432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772019.684448:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428498432:0@lo:400: 00000100:00100000:3.0:1790772019.685769:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428498944:12345-0@lo:13: Request processed in 1418us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772019.685839:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790772019.686808:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e84700 x1877760428498304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1790772019.686813:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25e305c00 x1877760428498944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772019.686844:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428498304:0@lo:400: 00010000:00080000:2.0:1790772019.686862:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e87480 x1877760428498816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772019.686870:0:3293:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790772019.686885:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428498816:0@lo:400: 00000100:00100000:2.0:1790772019.686896:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428498176:0@lo:400: 00010000:00080000:2.0:1790772019.686908:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e85f80 x1877760428498688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772019.686916:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428498688:0@lo:400: 00000100:00100000:0.0:1790772019.687019:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428498944:0@lo:13: 00000100:00100000:3.0:1790772019.756714:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772019.756854:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412746112 00000100:00100000:0.0:1790772019.756867:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412746112 00000100:00100000:0.0:1790772019.756920:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 113 00000100:00100000:0.0:1790772019.756929:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2346:x1877760412746112:12345-192.168.206.27@tcp:250: 00010000:00080000:0.0:1790772019.756965:0:5818:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 36c23a58-79a4-4ff1-a93b-1cfd03211375@192.168.206.27@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1790772019.756996:0:5818:0:(genops.c:1384:class_connect()) connect: client 36c23a58-79a4-4ff1-a93b-1cfd03211375, cookie 0xdf68d9a7d6a8fe27 00000100:00080000:0.0:1790772019.757184:0:5818:0:(import.c:65:import_set_state_nolock()) ffff8df27af1a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772019.757888:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+5:2346:x1877760412746112:12345-192.168.206.27@tcp:250: Request processed in 955us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772019.757914:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 113 00000100:00100000:3.0:1790772019.765937:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772019.766029:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412745984 00000100:00100000:0.0:1790772019.766040:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412745984 00000100:00100000:0.0:1790772019.766110:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:0.0:1790772019.766120:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+5:5575:x1877760412745984:12345-192.168.206.27@tcp:101: 00010000:00010000:0.0:1790772019.766150:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772019.766181:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031a00/0xdf68d9a7d6a8fe2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2268a6 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.766215:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031a00/0xdf68d9a7d6a8fe2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268a6 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.766238:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031a00/0xdf68d9a7d6a8fe2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268a6 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.766249:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031a00, rc 0) 00000100:00100000:0.0:1790772019.766898:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+6:5575:x1877760412745984:12345-192.168.206.27@tcp:101: Request processed in 775us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772019.766908:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:3.0:1790772019.772871:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772019.773113:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412746240 00000100:00100000:0.0:1790772019.773126:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412746240 00000100:00100000:0.0:1790772019.773899:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 115 00000100:00100000:0.0:1790772019.773911:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+6:5575:x1877760412746240:12345-192.168.206.27@tcp:501: 00000100:00100000:0.0:1790772019.774863:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+6:5575:x1877760412746240:12345-192.168.206.27@tcp:501: Request processed in 942us (1994us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772019.774876:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 115 00000100:00100000:1.0:1790772019.784450:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772019.784638:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412746368 00000100:00100000:0.0:1790772019.784657:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412746368 00000100:00100000:0.0:1790772019.784721:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 116 00000100:00100000:0.0:1790772019.784732:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+6:5575:x1877760412746368:12345-192.168.206.27@tcp:101: 00010000:00010000:0.0:1790772019.784753:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772019.784785:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031c00/0xdf68d9a7d6a8fe35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2268ad expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.784832:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031c00/0xdf68d9a7d6a8fe35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268ad expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.784846:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031c00/0xdf68d9a7d6a8fe35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268ad expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.784856:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031c00, rc 0) 00000100:00100000:0.0:1790772019.784925:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+7:5575:x1877760412746368:12345-192.168.206.27@tcp:101: Request processed in 195us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772019.784933:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 116 00000100:00100000:3.0:1790772019.788486:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772019.789967:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412746496 00000100:00100000:0.0:1790772019.789986:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412746496 00000100:00100000:0.0:1790772019.790951:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 117 00000100:00100000:0.0:1790772019.790970:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+7:5575:x1877760412746496:12345-192.168.206.27@tcp:501: 00000100:00100000:0.0:1790772019.791744:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:5575:x1877760412746496:12345-192.168.206.27@tcp:501: Request processed in 777us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772019.791756:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 117 00000100:00100000:3.0:1790772019.796835:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772019.796961:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412746624 00000100:00100000:2.0:1790772019.796974:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412746624 00000100:00100000:2.0:1790772019.797047:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 118 00000100:00100000:2.0:1790772019.797057:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:5575:x1877760412746624:12345-192.168.206.27@tcp:503: 00000100:00100000:2.0:1790772019.797799:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:5575:x1877760412746624:12345-192.168.206.27@tcp:503: Request processed in 737us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772019.797810:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 118 00000100:00100000:1.0:1790772019.802535:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772019.809825:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412746752 00000100:00100000:3.0:1790772019.809844:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412746752 00000100:00100000:2.0:1790772019.810085:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00100000:2.0:1790772019.810096:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:5594:x1877760412746752:12345-192.168.206.27@tcp:502: 00000100:00100000:2.0:1790772019.810969:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:5594:x1877760412746752:12345-192.168.206.27@tcp:502: Request processed in 871us (8442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772019.810980:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00100000:3.0:1790772019.859491:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772019.867868:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412746880 00000100:00100000:2.0:1790772019.867890:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412746880 00000100:00100000:2.0:1790772019.868005:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00100000:2.0:1790772019.868017:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:5594:x1877760412746880:12345-192.168.206.27@tcp:502: 00000100:00100000:2.0:1790772019.868380:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:5594:x1877760412746880:12345-192.168.206.27@tcp:502: Request processed in 364us (8960us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772019.868390:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00100000:1.0:1790772019.875002:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772019.876938:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412747008 00000100:00100000:0.0:1790772019.876958:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412747008 00000100:00100000:0.0:1790772019.877044:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 121 00000100:00100000:0.0:1790772019.877056:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:5575:x1877760412747008:12345-192.168.206.27@tcp:101: 00010000:00010000:0.0:1790772019.877092:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772019.877114:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fe3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2268d7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.877148:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fe3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268d7 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.877160:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fe3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268d7 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.877169:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031000, rc 0) 00000100:00100000:0.0:1790772019.877759:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5575:x1877760412747008:12345-192.168.206.27@tcp:101: Request processed in 701us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772019.878209:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 121 00000100:00100000:1.0:1790772019.881755:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772019.882095:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412747136 00000100:00100000:2.0:1790772019.882109:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412747136 00000100:00100000:2.0:1790772019.882177:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 122 00000100:00100000:2.0:1790772019.882187:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5575:x1877760412747136:12345-192.168.206.27@tcp:256: 20000000:01000000:2.0:1790772019.882220:0:5816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790772019.882246:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790772019.882251:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790772019.882255:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790772019.882257:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790772019.886169:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5575:x1877760412747136:12345-192.168.206.27@tcp:256: Request processed in 3969us (4412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772019.886186:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 122 00000100:00100000:1.0:1790772019.889170:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772019.890102:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412747264 00000100:00100000:0.0:1790772019.890119:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412747264 00000100:00100000:0.0:1790772019.890194:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 123 00000100:00100000:0.0:1790772019.890206:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5575:x1877760412747264:12345-192.168.206.27@tcp:101: 00010000:00010000:0.0:1790772019.890237:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772019.890258:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fe43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2268de expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.890521:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fe43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268de expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.890535:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fe43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268de expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772019.890545:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031600, rc 0) 00000100:00100000:0.0:1790772019.890746:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5575:x1877760412747264:12345-192.168.206.27@tcp:101: Request processed in 541us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772019.890754:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 123 00000100:00100000:1.0:1790772019.893337:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772019.893443:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412747392 00000100:00100000:3.0:1790772019.893456:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412747392 00000100:00100000:3.0:1790772019.893522:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 124 00000100:00100000:3.0:1790772019.893533:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5575:x1877760412747392:12345-192.168.206.27@tcp:501: 00000100:00100000:3.0:1790772019.894187:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5575:x1877760412747392:12345-192.168.206.27@tcp:501: Request processed in 653us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772019.894196:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 124 00000100:00100000:2.0:1790772019.896315:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772019.896605:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412747520 00000100:00100000:1.0:1790772019.896616:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412747520 00000100:00100000:1.0:1790772019.896848:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 125 00000100:00100000:1.0:1790772019.896862:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5575:x1877760412747520:12345-192.168.206.27@tcp:503: 00000100:00100000:1.0:1790772019.897501:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5575:x1877760412747520:12345-192.168.206.27@tcp:503: Request processed in 639us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772019.897511:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 125 00000100:00100000:1.0:1790772019.899786:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772019.899888:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412747648 00000100:00100000:3.0:1790772019.899904:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412747648 00000100:00100000:3.0:1790772019.899971:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 126 00000100:00100000:3.0:1790772019.899982:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5599:x1877760412747648:12345-192.168.206.27@tcp:502: 00000100:00100000:3.0:1790772019.900388:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5599:x1877760412747648:12345-192.168.206.27@tcp:502: Request processed in 406us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772019.900408:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 126 00000100:00100000:0.0:1790772019.902544:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772019.902818:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412747776 00000100:00100000:1.0:1790772019.902831:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412747776 00000100:00100000:1.0:1790772019.902898:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 127 00000100:00100000:1.0:1790772019.902909:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5599:x1877760412747776:12345-192.168.206.27@tcp:502: 00000100:00100000:1.0:1790772019.903264:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5599:x1877760412747776:12345-192.168.206.27@tcp:502: Request processed in 355us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772019.903272:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 127 00000100:00100000:2.0:1790772019.907151:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772019.907287:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412747904 00000100:00100000:3.0:1790772019.907298:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412747904 00000100:00100000:3.0:1790772019.907419:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:3.0:1790772019.907439:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2346:x1877760412747904:12345-192.168.206.27@tcp:38: 00010000:00080000:3.0:1790772019.907475:0:5824:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1790772019.907532:0:5824:0:(genops.c:1384:class_connect()) connect: client 9271f5fd-fa87-4f6b-a8bf-0936e195e8be, cookie 0xdf68d9a7d6a8fe4a 00000004:00100000:3.0:1790772019.907612:0:5824:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1790772019.907620:0:5824:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1790772019.941760:0:5824:0:(import.c:65:import_set_state_nolock()) ffff8df273eba800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772019.941912:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2346:x1877760412747904:12345-192.168.206.27@tcp:38: Request processed in 34480us (34772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772019.941923:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:0.0:1790772020.192001:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428499072:0@lo:13: 00000100:00100000:0.0:1790772020.192090:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772020.195843:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428499072 00000100:00100000:1.0:1790772020.195866:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428499072 00000100:00100000:1.0:1790772020.197808:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772020.197850:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428499072:12345-0@lo:13: 00002000:00000024:1.0:1790772020.197904:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772020.198097:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428499072:12345-0@lo:13: Request processed in 257us (6007us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772020.198106:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1790772020.200975:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747d5180 x1877760428499072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772020.201010:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428499072:0@lo:13: 00010000:00010000:2.0:1790772020.257205:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772020.952210:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772020.952259:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772020.952418:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412748032 00000100:00100000:0.0:1790772020.952419:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412748160 00000100:00100000:2.0:1790772020.952430:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412748032 00000100:00100000:0.0:1790772020.952430:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412748160 00000100:00080000:1.0:1790772020.952511:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772020.952581:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:0.0:1790772020.952594:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:5575:x1877760412748160:12345-192.168.206.27@tcp:41: 00000004:00000024:0.0:1790772020.952648:0:6701:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790772020.952732:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:5575:x1877760412748160:12345-192.168.206.27@tcp:41: Request processed in 141us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772020.952740:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:0.0:1790772020.952765:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:0.0:1790772020.952771:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:0:x1877760412748032:12345-192.168.206.27@tcp:41: 00000004:00000024:0.0:1790772020.952782:0:6701:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790772020.952803:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:0:x1877760412748032:12345-192.168.206.27@tcp:41: Request processed in 32us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772020.952809:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:2.0:1790772020.962907:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772020.964231:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412748288 00000100:00100000:0.0:1790772020.964247:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412748288 00000100:00100000:0.0:1790772020.964349:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1790772020.964375:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:5575:x1877760412748288:12345-192.168.206.27@tcp:40: 00000100:00100000:0.0:1790772020.964496:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:5575:x1877760412748288:12345-192.168.206.27@tcp:40: Request processed in 136us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772020.964504:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:1.0:1790772020.969830:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772020.969890:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772020.970067:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412748800 00000100:00100000:3.0:1790772020.970090:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412748800 00000100:00100000:3.0:1790772020.970158:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 128 00000100:00100000:3.0:1790772020.970168:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2349:x1877760412748800:12345-192.168.206.27@tcp:400: 00000100:00100000:3.0:1790772020.970253:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2349:x1877760412748800:12345-192.168.206.27@tcp:400: Request processed in 85us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772020.970261:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 128 00000100:00100000:2.0:1790772020.970388:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412748672 00000100:00100000:2.0:1790772020.970393:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412748672 00000100:00100000:2.0:1790772020.970520:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:2.0:1790772020.970531:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:5575:x1877760412748672:12345-192.168.206.27@tcp:33: 00000100:00100000:0.0:1790772020.985031:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772020.985140:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772020.994792:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412748416 00000100:00100000:3.0:1790772020.994811:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412748416 00000100:00100000:3.0:1790772020.994885:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412748544 00000100:00100000:3.0:1790772020.994889:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412748544 00000100:00100000:3.0:1790772020.994912:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:3.0:1790772020.994921:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1877760412748416:12345-192.168.206.27@tcp:8: 00010000:00080000:3.0:1790772020.994961:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1790772020.995011:0:6677:0:(genops.c:1384:class_connect()) connect: client 9271f5fd-fa87-4f6b-a8bf-0936e195e8be, cookie 0xdf68d9a7d6a8fe51 00002000:00100000:3.0:1790772020.995025:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9271f5fd-fa87-4f6b-a8bf-0936e195e8be/ffff8df27c047000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790772020.995055:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790772020.995682:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790772020.995723:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8df27c046800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772020.995817:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2346:x1877760412748416:12345-192.168.206.27@tcp:8: Request processed in 894us (10798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772020.995826:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:3.0:1790772020.995853:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:3.0:1790772020.995858:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1877760412748544:12345-192.168.206.27@tcp:8: 00010000:00080000:3.0:1790772020.995876:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1790772020.995894:0:6677:0:(genops.c:1384:class_connect()) connect: client 9271f5fd-fa87-4f6b-a8bf-0936e195e8be, cookie 0xdf68d9a7d6a8fe58 00002000:00100000:3.0:1790772020.995902:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9271f5fd-fa87-4f6b-a8bf-0936e195e8be/ffff8df27c044000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790772020.995909:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790772020.996110:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790772020.996127:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8df27c045000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772020.996152:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2346:x1877760412748544:12345-192.168.206.27@tcp:8: Request processed in 292us (11012us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772020.996158:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000004:00080000:2.0:1790772021.000129:0:5826:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29496us 00000004:00200000:3.0:1790772021.012441:0:5826:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790772021.012606:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:5575:x1877760412748672:12345-192.168.206.27@tcp:33: Request processed in 42069us (42783us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772021.012622:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:2.0:1790772021.240924:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772021.241048:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412748928 00000100:00100000:0.0:1790772021.241062:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412748928 00000100:00100000:0.0:1790772021.241132:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:0.0:1790772021.241143:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:5616:x1877760412748928:12345-192.168.206.27@tcp:101: 00010000:00010000:0.0:1790772021.241171:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772021.241202:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a8fe5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226908 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772021.241316:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a8fe66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772021.241332:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a8fe66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772021.241348:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a8fe66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772021.241397:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790772021.241402:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772021.241420:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a8fe66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772021.241447:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a8fe5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226908 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772021.241476:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a8fe66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226908 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772021.241485:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df254043c00) 00010000:00010000:0.0:1790772021.241488:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772021.241492:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9400, rc 0) 00000100:00100000:0.0:1790772021.241617:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:5616:x1877760412748928:12345-192.168.206.27@tcp:101: Request processed in 475us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772021.241626:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00010000:00010000:3.0:1790772021.279976:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772022.305139:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772023.327808:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772023.373624:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772023.373727:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412749056 00000100:00100000:2.0:1790772023.373740:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412749056 00000100:00100000:2.0:1790772023.373835:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:2.0:1790772023.373847:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:5669:x1877760412749056:12345-192.168.206.27@tcp:41: 00000004:00000024:2.0:1790772023.373901:0:5823:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790772023.373991:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:5669:x1877760412749056:12345-192.168.206.27@tcp:41: Request processed in 147us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772023.374000:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00080000:1.0:1790772023.377091:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772023.378734:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772023.379809:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412749184 00000100:00100000:3.0:1790772023.379824:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412749184 00000100:00100000:3.0:1790772023.379925:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:3.0:1790772023.379936:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:5669:x1877760412749184:12345-192.168.206.27@tcp:13: 00002000:00000024:3.0:1790772023.379991:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772023.380085:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:5669:x1877760412749184:12345-192.168.206.27@tcp:13: Request processed in 150us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772023.380093:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00080000:1.0:1790772023.380458:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772023.382845:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772023.383104:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412749312 00000100:00100000:3.0:1790772023.383117:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412749312 00000100:00100000:3.0:1790772023.383216:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:3.0:1790772023.383227:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:5669:x1877760412749312:12345-192.168.206.27@tcp:13: 00002000:00000024:3.0:1790772023.383272:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772023.383361:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:5669:x1877760412749312:12345-192.168.206.27@tcp:13: Request processed in 136us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772023.383370:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00080000:1.0:1790772023.383515:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790772024.354831:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790772024.377389:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000100:00100000:0.0:1790772024.800607:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428499584:0@lo:400: 00000100:00100000:0.0:1790772024.800694:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772024.801369:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772024.801382:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428499456:0@lo:400: 00000100:00100000:2.0:1790772024.801385:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428499200:0@lo:400: 00000100:00100000:0.0:1790772024.801438:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772024.801444:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772024.801482:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428499712:0@lo:400: 00000100:00100000:0.0:1790772024.801498:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428499456 00000100:00100000:0.0:1790772024.801508:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428499456 00000100:00100000:2.0:1790772024.801526:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772024.801574:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790772024.801582:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428499328:0@lo:400: 00000100:00100000:0.0:1790772024.801608:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428499712 00000100:00100000:2.0:1790772024.801612:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772024.801615:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428499712 00000100:00100000:1.0:1790772024.801900:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428499200 00000100:00100000:1.0:1790772024.801905:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428499200 00000100:00100000:1.0:1790772024.801950:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790772024.801961:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428499200:12345-0@lo:400: 00000100:00100000:1.0:1790772024.802323:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428499200:12345-0@lo:400: Request processed in 62us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772024.802333:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790772024.802349:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428499840:0@lo:400: 00000100:00100000:2.0:1790772024.802388:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790772024.802389:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772024.802428:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428499200:0@lo:400: 00000100:00100000:2.0:1790772024.802472:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428499968:0@lo:13: 00000100:00100000:2.0:1790772024.802502:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772024.802522:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428499328 00000100:00100000:0.0:1790772024.802529:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428499328 00000100:00100000:2.0:1790772024.802575:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428499584 00000100:00100000:2.0:1790772024.802581:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428499584 00000100:00100000:0.0:1790772024.802594:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790772024.802610:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428499456:12345-0@lo:400: 00000100:00100000:1.0:1790772024.802700:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428499968 00000100:00100000:2.0:1790772024.802704:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428499840 00000100:00100000:1.0:1790772024.802706:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428499968 00000100:00100000:2.0:1790772024.802710:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428499840 00000100:00100000:2.0:1790772024.802735:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772024.802742:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1877760428499584:12345-0@lo:400: 00000100:00100000:1.0:1790772024.802838:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772024.802845:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1877760428499968:12345-0@lo:13: 00000100:00100000:0.0:1790772024.803079:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428499456:12345-0@lo:400: Request processed in 475us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772024.803096:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790772024.803115:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790772024.803122:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428499712:12345-0@lo:400: 00000100:00100000:0.0:1790772024.803163:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428499712:12345-0@lo:400: Request processed in 41us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772024.803169:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790772024.803182:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790772024.803188:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428499328:12345-0@lo:400: 00000100:00100000:2.0:1790772024.803212:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1877760428499584:12345-0@lo:400: Request processed in 468us (2516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772024.803221:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772024.803226:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428499328:12345-0@lo:400: Request processed in 37us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772024.803235:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772024.803318:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772024.803327:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428499840:12345-0@lo:400: 00000100:00100000:2.0:1790772024.803374:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428499840:12345-0@lo:400: Request processed in 48us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772024.803381:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772024.803434:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428499328:0@lo:400: 00010000:00080000:2.0:1790772024.803449:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27b281880 x1877760428499840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1790772024.803453:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772024.803465:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428499840:0@lo:400: 00000100:00100000:2.0:1790772024.803479:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428499712:0@lo:400: 00000100:00080000:2.0:1790772024.803510:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790772024.803515:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772024.803525:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428499968:12345-0@lo:13: Request processed in 679us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772024.803533:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1790772024.806952:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25e306300 x1877760428499968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772024.806989:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428499968:0@lo:13: 00000100:00100000:3.0:1790772024.807435:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428499456:0@lo:400: 00010000:00080000:3.0:1790772024.807454:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27b281180 x1877760428499584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772024.807465:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428499584:0@lo:400: 00000100:00100000:3.0:1790772025.312502:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428500096:0@lo:13: 00000100:00100000:3.0:1790772025.312606:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772025.313211:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428500096 00000100:00100000:0.0:1790772025.313223:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428500096 00000100:00100000:0.0:1790772025.313283:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772025.313293:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428500096:12345-0@lo:13: 00002000:00000024:0.0:1790772025.313334:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772025.313409:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428500096:12345-0@lo:13: Request processed in 117us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772025.313417:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1790772025.313474:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747d5880 x1877760428500096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772025.313494:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428500096:0@lo:13: 00010000:00010000:1.0:1790772025.376237:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790772025.376307:0:5845:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000001:00100000:1.0:1790772025.909629:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000001:02000400:0.0:1790772025.915196:0:8278:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1790772026.400657:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772026.409425:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772026.409476:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772026.409513:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772026.409581:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772026.409615:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412749696 00000100:00100000:2.0:1790772026.409627:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412749696 00000100:00100000:2.0:1790772026.409690:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412749824 00000100:00100000:2.0:1790772026.409694:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412749824 00000100:00100000:2.0:1790772026.409712:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:2.0:1790772026.409724:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412749696:12345-192.168.206.27@tcp:400: 00000100:00100000:2.0:1790772026.409820:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412749696:12345-192.168.206.27@tcp:400: Request processed in 98us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772026.409828:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:2.0:1790772026.409847:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:2.0:1790772026.409853:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412749824:12345-192.168.206.27@tcp:400: 00000100:00100000:2.0:1790772026.409875:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412749824:12345-192.168.206.27@tcp:400: Request processed in 23us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772026.409881:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00080000:2.0:1790772026.409897:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790772026.409901:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772026.410877:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412749440 00000100:00100000:0.0:1790772026.410889:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412749440 00000100:00100000:0.0:1790772026.410958:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 130 00000100:00100000:0.0:1790772026.410968:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412749440:12345-192.168.206.27@tcp:400: 00000100:00100000:0.0:1790772026.411025:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412749440:12345-192.168.206.27@tcp:400: Request processed in 60us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772026.411033:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 130 00000100:00100000:1.0:1790772026.417154:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412749568 00000100:00100000:1.0:1790772026.417177:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412749568 00000100:00100000:1.0:1790772026.417313:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:1.0:1790772026.417327:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412749568:12345-192.168.206.27@tcp:400: 00000100:00100000:1.0:1790772026.419276:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412749568:12345-192.168.206.27@tcp:400: Request processed in 1938us (9747us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772026.419293:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00080000:2.0:1790772026.420324:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790772027.437220:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772028.447836:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790772029.305010:0:8426:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0fb193b0 20000000:00000080:3.0:1790772029.305029:0:8426:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df274591c00 uarg=0000000000000000 20000000:01000000:3.0:1790772029.305073:0:8426:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1790772029.305076:0:8426:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1790772029.305079:0:8426:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790772029.305084:0:8426:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790772029.305089:0:8426:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1790772029.305102:0:8426:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790772029.305104:0:8426:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790772029.305376:0:8426:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790772029.305379:0:8426:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790772029.306728:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1790772029.307492:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1790772029.307574:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1790772029.307730:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1790772029.307747:0:8426:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790772029.307749:0:8426:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790772029.312114:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1790772029.313118:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1790772029.313190:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1790772029.313231:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1790772029.313245:0:8426:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790772029.313247:0:8426:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790772029.315264:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1790772029.316033:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1790772029.316103:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1790772029.316144:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1790772029.316157:0:8426:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790772029.316160:0:8426:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790772029.317480:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1790772029.318512:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1790772029.318918:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1790772029.318983:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:1.0:1790772029.319002:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790772029.319021:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319039:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a8fd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd63 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319047:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd8d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319053:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fdbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdb7 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319060:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df240030200/0xdf68d9a7d6a8fdcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdc5 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319066:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df240030a00/0xdf68d9a7d6a8fdda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdd3 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319081:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8fdf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fdef expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319088:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fe20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe19 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319096:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df240031a00/0xdf68d9a7d6a8fe2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268a6 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319103:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df240031c00/0xdf68d9a7d6a8fe35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268ad expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319110:0:8426:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319150:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df240031c00/0xdf68d9a7d6a8fe35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268ad expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319229:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df240031c00/0xdf68d9a7d6a8fe35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268ad expref: 9 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.319246:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500224:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772029.319359:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df240031a00/0xdf68d9a7d6a8fe2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268a6 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319368:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df240031a00/0xdf68d9a7d6a8fe2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268a6 expref: 9 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.319376:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500352:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772029.319415:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fe20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fe19 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319423:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fe20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fe19 expref: 18 pid: 5817 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.319432:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500480:0@lo:104: 00000100:00100000:1.0:1790772029.319474:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790772029.319585:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8fdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdef expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.319658:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8fdf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdef expref: 18 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.319668:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500608:0@lo:104: 00000100:00100000:1.0:1790772029.319696:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790772029.323447:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df240030a00/0xdf68d9a7d6a8fdda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdd3 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.323466:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df240030a00/0xdf68d9a7d6a8fdda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdd3 expref: 18 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.323492:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500736:0@lo:104: 00010000:00010000:1.0:1790772029.323545:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df240030200/0xdf68d9a7d6a8fdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdc5 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.323569:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df240030200/0xdf68d9a7d6a8fdcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdc5 expref: 18 pid: 5818 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.323578:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500864:0@lo:104: 00010000:00010000:1.0:1790772029.323627:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fdbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdb7 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.323635:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fdbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdb7 expref: 18 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.323644:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500992:0@lo:104: 00010000:00010000:1.0:1790772029.323671:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd8d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.323680:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd8d expref: 18 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.323687:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428501120:0@lo:104: 00010000:00010000:1.0:1790772029.323708:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a8fd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd63 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.323715:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a8fd6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd63 expref: 18 pid: 5818 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.323722:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428501248:0@lo:104: 00000100:00100000:1.0:1790772029.323735:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142accc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772029.326931:0:5807:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790772029.326981:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772029.327009:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772029.327020:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772029.327030:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772029.327040:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772029.327050:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428500480 00000100:00100000:3.0:1790772029.327058:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428500480 00000100:00100000:3.0:1790772029.327102:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428500608 00000100:00100000:3.0:1790772029.327106:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428500608 00000100:00100000:3.0:1790772029.327116:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428500736 00000100:00100000:3.0:1790772029.327119:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428500736 00000100:00100000:3.0:1790772029.327127:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428500864 00000100:00100000:3.0:1790772029.327129:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428500864 00000100:00100000:3.0:1790772029.327137:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428500992 00000100:00100000:3.0:1790772029.327140:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428500992 00000100:00100000:3.0:1790772029.327148:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428501120 00000100:00100000:2.0:1790772029.327283:0:5806:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:2.0:1790772029.327289:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428501248 00000100:00100000:2.0:1790772029.327292:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428501248 00000100:00100000:2.0:1790772029.327326:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772029.327336:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+8:8426:x1877760428500480:12345-0@lo:104: 00010000:00010000:2.0:1790772029.327360:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.327576:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500480:0@lo:104: 00000100:00100000:3.0:1790772029.327720:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428501120 00010000:00010000:2.0:1790772029.327782:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772029.327789:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+9:8426:x1877760428500480:12345-0@lo:104: Request processed in 455us (8315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772029.327797:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772029.327815:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772029.327822:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcd8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+8:8426:x1877760428500608:12345-0@lo:104: 00010000:00010000:2.0:1790772029.327830:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.327923:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500608:0@lo:104: 00010000:00010000:0.0:1790772029.328374:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772029.328382:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772029.328390:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1790772029.328395:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772029.328405:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772029.328413:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772029.328428:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772029.328992:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.329001:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772029.329035:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.329051:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8000/0xdf68d9a7d6a8fe19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fe20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.329064:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772029.329068:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.329074:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390c00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772029.329078:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.329086:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772029.329092:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772029.329097:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772029.329142:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1790772029.329151:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcd8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+8:8426:x1877760428500608:12345-0@lo:104: Request processed in 1328us (9453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772029.329159:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772029.329225:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772029.329235:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+7:8426:x1877760428500736:12345-0@lo:104: 00010000:00010000:2.0:1790772029.329244:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772029.329303:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772029.329308:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+7:8426:x1877760428500736:12345-0@lo:104: Request processed in 77us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772029.329314:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772029.329337:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772029.329343:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+6:8426:x1877760428500864:12345-0@lo:104: 00010000:00010000:2.0:1790772029.329358:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772029.329389:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790772029.329394:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+6:8426:x1877760428500864:12345-0@lo:104: Request processed in 52us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772029.329400:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772029.329413:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790772029.329418:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:8426:x1877760428500992:12345-0@lo:104: 00010000:00010000:2.0:1790772029.329425:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772029.329450:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790772029.329454:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:8426:x1877760428500992:12345-0@lo:104: Request processed in 36us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772029.329459:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790772029.329471:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790772029.329476:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:8426:x1877760428501248:12345-0@lo:104: 00010000:00010000:2.0:1790772029.329483:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772029.329519:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790772029.329523:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:8426:x1877760428501248:12345-0@lo:104: Request processed in 48us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772029.329535:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790772029.329567:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790772029.329574:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:8426:x1877760428501120:12345-0@lo:104: 00010000:00010000:2.0:1790772029.329587:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772029.329998:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790772029.330004:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:8426:x1877760428501120:12345-0@lo:104: Request processed in 431us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772029.330011:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790772029.330130:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428501376:0@lo:103: 00000100:00100000:0.0:1790772029.330169:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790772029.331632:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331645:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772029.331667:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331675:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df241390c00/0xdf68d9a7d6a8fdef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdf6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331692:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790772029.331711:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331718:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772029.331722:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331731:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772029.331738:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772029.331744:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772029.331761:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331768:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772029.331783:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331790:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a8fdd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdda expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331799:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790772029.331803:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331809:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772029.331812:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331830:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772029.331836:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772029.331946:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772029.331962:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331968:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772029.331974:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331980:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df2414a3400/0xdf68d9a7d6a8fdc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdcc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.331992:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790772029.331996:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332000:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030600 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772029.332003:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332009:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772029.332015:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772029.332026:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772029.332041:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332046:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772029.332051:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332056:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a8fdb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fdbe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332064:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772029.332067:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332072:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772029.332074:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332080:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772029.332085:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772029.332089:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772029.332099:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332104:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772029.332114:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332120:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9000/0xdf68d9a7d6a8fd63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd6a expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332128:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772029.332132:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332136:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772029.332139:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332144:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772029.332149:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772029.332154:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772029.332178:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332183:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772029.332187:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332192:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df2414a3000/0xdf68d9a7d6a8fd8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd94 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.332205:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772029.332213:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772029.332227:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772029.332247:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428501632:0@lo:103: 00000100:00100000:1.0:1790772029.332306:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772029.332355:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428502144:0@lo:103: 00000100:00100000:1.0:1790772029.332375:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772029.332401:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772029.332406:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428501760:0@lo:103: 00000100:00100000:1.0:1790772029.332424:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772029.332452:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428501888:0@lo:103: 00000100:00100000:1.0:1790772029.332473:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772029.332513:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790772029.332518:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428501504:0@lo:103: 00000100:00100000:1.0:1790772029.332538:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772029.332578:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428502016:0@lo:103: 00000100:00100000:1.0:1790772029.332724:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772029.332781:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500736:0@lo:104: 00000100:00100000:1.0:1790772029.332791:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500864:0@lo:104: 00000100:00100000:1.0:1790772029.332799:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500992:0@lo:104: 00000100:00100000:1.0:1790772029.332807:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428501120:0@lo:104: 00000100:00100000:1.0:1790772029.332815:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428501248:0@lo:104: 00000100:00100000:3.0:1790772029.332945:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428501376 00000100:00100000:3.0:1790772029.332953:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428501376 00010000:00010000:3.0:1790772029.332984:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fe20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fe19 expref: 19 pid: 5817 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772029.333005:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428501632 00000100:00100000:3.0:1790772029.333008:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428501632 00010000:00010000:3.0:1790772029.333019:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df240030a00/0xdf68d9a7d6a8fdda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdd3 expref: 20 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772029.333031:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428502144 00000100:00100000:3.0:1790772029.333033:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428502144 00010000:00010000:3.0:1790772029.333043:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd8d expref: 21 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772029.333052:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428501760 00000100:00100000:3.0:1790772029.333054:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428501760 00010000:00010000:3.0:1790772029.333061:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df240030200/0xdf68d9a7d6a8fdcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdc5 expref: 22 pid: 5818 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772029.333070:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428501888 00000100:00100000:3.0:1790772029.333072:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428501888 00010000:00010000:3.0:1790772029.333079:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fdbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdb7 expref: 23 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772029.333087:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428501504 00000100:00100000:3.0:1790772029.333089:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428501504 00010000:00010000:3.0:1790772029.333096:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8fdf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdef expref: 24 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772029.333104:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428502016 00000100:00100000:3.0:1790772029.333106:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428502016 00010000:00010000:3.0:1790772029.333127:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a8fd6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd63 expref: 25 pid: 5818 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772029.333141:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790772029.333149:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+25:3293:x1877760428501376:12345-0@lo:103: 00010000:00010000:3.0:1790772029.333172:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772029.333178:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fe20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fe19 expref: 25 pid: 5817 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333196:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fe20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fe19 expref: 25 pid: 5817 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333211:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fe20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fe19 expref: 25 pid: 5817 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333225:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772029.333266:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+24:3293:x1877760428501376:12345-0@lo:103: Request processed in 118us (3096us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.333272:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790772029.333290:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790772029.333296:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+23:3295:x1877760428501632:12345-0@lo:103: 00010000:00010000:3.0:1790772029.333303:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772029.333308:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df240030a00/0xdf68d9a7d6a8fdda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdd3 expref: 23 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333328:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df240030a00/0xdf68d9a7d6a8fdda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdd3 expref: 23 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333338:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240030a00/0xdf68d9a7d6a8fdda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdd3 expref: 23 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333356:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772029.333389:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+22:3295:x1877760428501632:12345-0@lo:103: Request processed in 93us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.333395:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790772029.333407:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772029.333413:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+21:3295:x1877760428502144:12345-0@lo:103: 00010000:00010000:3.0:1790772029.333420:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772029.333424:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd8d expref: 21 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333432:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd8d expref: 21 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333441:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8fd94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd8d expref: 21 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333450:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772029.333470:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+20:3295:x1877760428502144:12345-0@lo:103: Request processed in 59us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.333476:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772029.333487:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772029.333492:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428501760:12345-0@lo:103: 00010000:00010000:3.0:1790772029.333500:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772029.333504:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df240030200/0xdf68d9a7d6a8fdcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdc5 expref: 19 pid: 5818 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333511:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df240030200/0xdf68d9a7d6a8fdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdc5 expref: 19 pid: 5818 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333528:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240030200/0xdf68d9a7d6a8fdcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdc5 expref: 19 pid: 5818 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333537:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772029.333578:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:3295:x1877760428501760:12345-0@lo:103: Request processed in 86us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.333585:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772029.333755:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772029.333763:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:3293:x1877760428501888:12345-0@lo:103: 00010000:00010000:3.0:1790772029.333771:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772029.333776:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fdbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdb7 expref: 17 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333784:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fdbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdb7 expref: 17 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333793:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a8fdbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdb7 expref: 17 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333801:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772029.333824:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3293:x1877760428501888:12345-0@lo:103: Request processed in 63us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.333830:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772029.333916:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772029.333923:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:3293:x1877760428501504:12345-0@lo:103: 00010000:00010000:3.0:1790772029.333932:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772029.333936:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8fdf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdef expref: 15 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333950:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8fdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdef expref: 15 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333959:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8fdf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fdef expref: 15 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.333968:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772029.333993:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:3293:x1877760428501504:12345-0@lo:103: Request processed in 71us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.333999:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772029.334012:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772029.334018:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:3293:x1877760428502016:12345-0@lo:103: 00010000:00010000:3.0:1790772029.334029:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772029.334033:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a8fd6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd63 expref: 13 pid: 5818 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.334042:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a8fd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd63 expref: 13 pid: 5818 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.334051:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a8fd6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd63 expref: 13 pid: 5818 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.334060:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772029.334080:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3293:x1877760428502016:12345-0@lo:103: Request processed in 62us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.334086:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772029.334155:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428501760:0@lo:103: 00000100:00100000:3.0:1790772029.334166:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428501632:0@lo:103: 00000100:00100000:3.0:1790772029.334182:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428502144:0@lo:103: 00000100:00100000:1.0:1790772029.334366:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428501504:0@lo:103: 00000100:00100000:1.0:1790772029.334374:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428502016:0@lo:103: 00000100:00100000:1.0:1790772029.334382:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428501888:0@lo:103: 00000100:00100000:1.0:1790772029.334401:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428501376:0@lo:103: 00010000:00010000:2.0:1790772029.334518:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772029.338762:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772029.338804:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772029.338930:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412749952 00000100:00100000:3.0:1790772029.338939:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412749952 00010000:00010000:3.0:1790772029.338978:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df240031c00/0xdf68d9a7d6a8fe35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268ad expref: 10 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772029.339010:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412750080 00000100:00100000:3.0:1790772029.339013:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412750080 00010000:00010000:3.0:1790772029.339026:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df240031a00/0xdf68d9a7d6a8fe2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268a6 expref: 11 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772029.339044:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:3.0:1790772029.339052:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b283100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:2347:x1877760412749952:12345-192.168.206.27@tcp:103: 00010000:00010000:3.0:1790772029.339067:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772029.339073:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df240031c00/0xdf68d9a7d6a8fe35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268ad expref: 11 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339085:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df240031c00/0xdf68d9a7d6a8fe35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268ad expref: 11 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339104:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772029.339178:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b283100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:2347:x1877760412749952:12345-192.168.206.27@tcp:103: Request processed in 125us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.339185:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:3.0:1790772029.339204:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:3.0:1790772029.339211:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412750080:12345-192.168.206.27@tcp:103: 00010000:00010000:3.0:1790772029.339219:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772029.339240:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df240031a00/0xdf68d9a7d6a8fe2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268a6 expref: 10 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339249:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df240031a00/0xdf68d9a7d6a8fe2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268a6 expref: 10 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339263:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339272:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339288:0:7617:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339294:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339302:0:7617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339308:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339314:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8c00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772029.339330:0:7617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339338:0:7617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339346:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772029.339362:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772029.339384:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412750080:12345-192.168.206.27@tcp:103: Request processed in 173us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.339391:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00010000:00010000:1.0:1790772029.340138:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240031c00/0xdf68d9a7d6a8fe35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268ad expref: 9 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.340154:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500224:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772029.340167:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240031a00/0xdf68d9a7d6a8fe2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268a6 expref: 8 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772029.340175:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1877760428500352:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772029.340216:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.340225:0:8426:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.340232:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.340239:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe6d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772029.471738:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772029.920021:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428502400:0@lo:400: 00000100:00100000:1.0:1790772029.920106:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772029.920181:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428502912:0@lo:400: 00000100:00100000:1.0:1790772029.920228:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772029.920261:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772029.920267:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428502528:0@lo:400: 00000100:00100000:1.0:1790772029.920297:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772029.920595:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428502656:0@lo:400: 00000100:00100000:3.0:1790772029.920629:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772029.920650:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790772029.920656:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428502272:0@lo:400: 00000100:00100000:3.0:1790772029.920687:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772029.920711:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428502784:0@lo:400: 00000100:00100000:3.0:1790772029.920732:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772029.920765:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428502272 00000100:00100000:3.0:1790772029.920773:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428502272 00000100:00100000:3.0:1790772029.920824:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790772029.920833:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3295:x1877760428502272:12345-0@lo:400: 00000100:00100000:3.0:1790772029.920893:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:3295:x1877760428502272:12345-0@lo:400: Request processed in 59us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.920900:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790772029.920937:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428502400 00000100:00100000:3.0:1790772029.920941:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428502400 00000100:00100000:3.0:1790772029.920965:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428502528 00000100:00100000:3.0:1790772029.920968:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428502528 00000100:00100000:3.0:1790772029.920989:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428502784 00000100:00100000:3.0:1790772029.920991:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428502784 00000100:00100000:3.0:1790772029.921005:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772029.921011:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428502400:12345-0@lo:400: 00000100:00100000:3.0:1790772029.921058:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428502400:12345-0@lo:400: Request processed in 47us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.921066:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772029.921078:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772029.921085:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428502528:12345-0@lo:400: 00000100:00100000:3.0:1790772029.921113:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428502528:12345-0@lo:400: Request processed in 28us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.921118:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772029.921129:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790772029.921203:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428502784:12345-0@lo:400: 00000100:00100000:3.0:1790772029.921232:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428502784:12345-0@lo:400: Request processed in 98us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772029.921239:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790772029.921275:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428502272:0@lo:400: 00000100:00100000:3.0:1790772029.921289:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428502784:0@lo:400: 00000100:00100000:2.0:1790772029.921463:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428502912 00000100:00100000:2.0:1790772029.921469:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428502912 00000100:00100000:2.0:1790772029.921502:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428502656 00000100:00100000:2.0:1790772029.921506:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428502656 00000100:00100000:2.0:1790772029.921524:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772029.921532:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428502912:12345-0@lo:400: 00000100:00100000:2.0:1790772029.921598:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428502912:12345-0@lo:400: Request processed in 67us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772029.921604:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772029.921618:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772029.921624:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428502656:12345-0@lo:400: 00000100:00100000:2.0:1790772029.921656:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428502656:12345-0@lo:400: Request processed in 33us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772029.921661:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1790772029.921685:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790772029.921689:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790772029.921693:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790772029.921771:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e85f80 x1877760428502656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772029.921783:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428502656:0@lo:400: 00000100:00100000:0.0:1790772029.922460:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428503040:0@lo:13: 00000100:00100000:0.0:1790772029.922510:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772029.923518:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428503040 00000100:00100000:2.0:1790772029.923531:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428503040 00000100:00100000:2.0:1790772029.923635:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772029.923645:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428503040:12345-0@lo:13: 00002000:00000024:2.0:1790772029.923705:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772029.923796:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428503040:12345-0@lo:13: Request processed in 152us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772029.923804:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790772029.923921:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428502528:0@lo:400: 00000100:00100000:1.0:1790772029.923935:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428502400:0@lo:400: 00010000:00080000:1.0:1790772029.923950:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e87480 x1877760428502912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772029.923961:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428502912:0@lo:400: 00010000:00080000:0.0:1790772029.924099:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25e305880 x1877760428503040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772029.924115:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428503040:0@lo:13: 00000100:00100000:0.0:1790772030.431810:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428503168:0@lo:13: 00000100:00100000:0.0:1790772030.431893:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.432256:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428503168 00000100:00100000:1.0:1790772030.432265:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428503168 00000100:00100000:1.0:1790772030.432333:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790772030.432344:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428503168:12345-0@lo:13: 00002000:00000024:1.0:1790772030.432379:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772030.432433:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428503168:12345-0@lo:13: Request processed in 91us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772030.432440:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1790772030.432482:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3e8a80 x1877760428503168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772030.432502:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428503168:0@lo:13: 00010000:00010000:1.0:1790772030.495884:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790772030.623959:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790772030.623969:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df273e99800 from 39 10000000:01000000:3.0:1790772030.623976:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790772030.624039:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.624052:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.624362:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772030.624464:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428503296:0@lo:101: 00000100:00100000:3.0:1790772030.625205:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772030.625286:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772030.625536:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428503296 00000100:00100000:2.0:1790772030.625546:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428503296 00000100:00100000:2.0:1790772030.625647:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790772030.625658:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+12:5820:x1877760428503296:12345-0@lo:101: 00010000:00010000:2.0:1790772030.625979:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772030.626005:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fe7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fe74 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772030.626034:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fe7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe74 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772030.626047:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fe7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe74 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772030.626067:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241390a00, rc 0) 00000100:00100000:2.0:1790772030.626295:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428503296:12345-0@lo:101: Request processed in 637us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772030.626302:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790772030.626473:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428503296:0@lo:101: 00010000:00010000:3.0:1790772030.626494:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.626504:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772030.626607:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428503424:0@lo:501: 00000100:00100000:3.0:1790772030.626695:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772030.626785:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772030.626824:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428503424 00000100:00100000:0.0:1790772030.626831:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428503424 00000100:00100000:0.0:1790772030.626906:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790772030.626915:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428503424:12345-0@lo:501: 00000100:00100000:0.0:1790772030.627260:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428503424:12345-0@lo:501: Request processed in 346us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772030.627268:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790772030.627364:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428503424:0@lo:501: 00000100:00100000:1.0:1790772030.627413:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428503552:0@lo:503: 00000100:00100000:1.0:1790772030.627458:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.627992:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142accb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772030.628133:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428503552 00000100:00100000:3.0:1790772030.628140:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428503552 00000100:00100000:3.0:1790772030.628186:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790772030.628195:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428503552:12345-0@lo:503: 00000100:00100000:3.0:1790772030.628582:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428503552:12345-0@lo:503: Request processed in 388us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772030.628590:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790772030.630322:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428503552:0@lo:503: 00000100:00100000:1.0:1790772030.631374:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8445:1877760428503680:0@lo:502: 00000100:00100000:1.0:1790772030.631491:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.631540:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428503680 00000100:00100000:1.0:1790772030.631547:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428503680 00000100:00100000:1.0:1790772030.631606:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790772030.631617:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:8445:x1877760428503680:12345-0@lo:502: 00000100:00100000:1.0:1790772030.631907:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:8445:x1877760428503680:12345-0@lo:502: Request processed in 290us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772030.631915:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790772030.631966:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772030.631984:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8445:1877760428503680:0@lo:502: 00000100:00100000:1.0:1790772030.632024:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8445:1877760428503808:0@lo:502: 00000100:00100000:1.0:1790772030.632323:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.632353:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428503808 00000100:00100000:1.0:1790772030.632358:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428503808 00000100:00100000:1.0:1790772030.632444:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790772030.632454:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:8445:x1877760428503808:12345-0@lo:502: 00000100:00100000:1.0:1790772030.632741:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:8445:x1877760428503808:12345-0@lo:502: Request processed in 288us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772030.632748:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790772030.632782:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772030.632795:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8445:1877760428503808:0@lo:502: 00000040:00080000:1.0:1790772030.632815:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1790772030.632883:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1790772030.632905:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790772030.632916:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.632939:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772030.632950:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1790772030.632953:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1790772030.632956:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790772030.632983:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.632992:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.633001:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772030.633013:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428503936:0@lo:101: 00000100:00100000:1.0:1790772030.633042:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772030.633378:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428503936 00000100:00100000:3.0:1790772030.633396:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428503936 00000100:00100000:3.0:1790772030.633423:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790772030.633432:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+13:5820:x1877760428503936:12345-0@lo:101: 00010000:00010000:3.0:1790772030.633449:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772030.633463:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fe89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fe82 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.633489:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fe89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe82 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.633501:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fe89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe82 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.633510:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df28204f000, rc 0) 00000100:00100000:3.0:1790772030.633540:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428503936:12345-0@lo:101: Request processed in 109us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772030.633546:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790772030.633756:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772030.633770:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428503936:0@lo:101: 00010000:00010000:1.0:1790772030.633784:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.633794:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772030.633842:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428504064:0@lo:501: 00000100:00100000:1.0:1790772030.633867:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.633887:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772030.634029:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428504064 00000100:00100000:0.0:1790772030.634035:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428504064 00000100:00100000:0.0:1790772030.634081:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790772030.634091:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428504064:12345-0@lo:501: 00000100:00100000:0.0:1790772030.634393:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428504064:12345-0@lo:501: Request processed in 294us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772030.634406:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790772030.634869:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428504064:0@lo:501: 00000100:00100000:1.0:1790772030.634904:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428504192:0@lo:503: 00000100:00100000:1.0:1790772030.634943:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.634962:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772030.636785:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428504192 00000100:00100000:0.0:1790772030.636801:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428504192 00000100:00100000:0.0:1790772030.636873:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790772030.636884:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428504192:12345-0@lo:503: 00000100:00100000:0.0:1790772030.637486:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428504192:12345-0@lo:503: Request processed in 602us (2540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772030.637495:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790772030.639236:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428504192:0@lo:503: 00000100:00100000:1.0:1790772030.640419:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8446:1877760428504320:0@lo:502: 00000100:00100000:1.0:1790772030.640513:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.640583:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acce40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772030.640700:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428504320 00000100:00100000:3.0:1790772030.640709:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428504320 00000100:00100000:3.0:1790772030.640753:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790772030.640763:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:8446:x1877760428504320:12345-0@lo:502: 00000100:00100000:3.0:1790772030.641022:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:8446:x1877760428504320:12345-0@lo:502: Request processed in 259us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772030.641030:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790772030.642288:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8446:1877760428504320:0@lo:502: 00000020:01000000:1.0:1790772030.642347:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772030.642361:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772030.642364:0:8446:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790772030.642371:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790772030.642426:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8446:1877760428504448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772030.642495:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.642533:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acce40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772030.642690:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428504448 00000100:00100000:2.0:1790772030.642698:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428504448 00000100:00100000:2.0:1790772030.642768:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790772030.642778:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:8446:x1877760428504448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772030.643031:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:8446:x1877760428504448:12345-0@lo:502:llog_process_th.0 Request processed in 253us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772030.643049:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790772030.643586:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8446:1877760428504448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790772030.643617:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772030.643624:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772030.643626:0:8446:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790772030.643631:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1790772030.645230:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1790772030.645267:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790772030.645281:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772030.645295:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772030.645306:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790772030.645321:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df242cf1800 from 39 10000000:01000000:2.0:1790772030.645324:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790772030.645369:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772030.645378:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772030.645463:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772030.645514:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428504576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772030.645674:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772030.645721:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27ac75840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772030.646236:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428504576 00000100:00100000:1.0:1790772030.646246:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428504576 00000100:00100000:1.0:1790772030.646317:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790772030.646328:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:5820:x1877760428504576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772030.646359:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772030.646374:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b9000/0xdf68d9a7d6a8fe97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fe90 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.646531:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b9000/0xdf68d9a7d6a8fe97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe90 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.646544:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b9000/0xdf68d9a7d6a8fe97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe90 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.646584:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9000, rc 0) 00000100:00100000:1.0:1790772030.646650:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428504576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 323us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772030.646657:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790772030.646753:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428504576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772030.646771:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.646781:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772030.646856:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428504704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772030.646887:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772030.646923:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f780c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772030.648799:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428504704 00000100:00100000:1.0:1790772030.648814:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428504704 00000100:00100000:1.0:1790772030.648883:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790772030.648894:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428504704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772030.650165:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428504704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1266us (3269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772030.650178:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790772030.651781:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428504704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772030.651856:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428504832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772030.651938:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772030.651988:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772030.652009:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428504832 00000100:00100000:2.0:1790772030.652018:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428504832 00000100:00100000:2.0:1790772030.652097:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790772030.652108:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428504832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772030.652368:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428504832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 261us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772030.652394:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790772030.652705:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428504832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772030.653358:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8447:1877760428504960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772030.653423:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772030.653461:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772030.653587:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428504960 00000100:00100000:2.0:1790772030.653594:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428504960 00000100:00100000:2.0:1790772030.653640:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790772030.653648:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:8447:x1877760428504960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772030.653907:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:8447:x1877760428504960:12345-0@lo:502:llog_process_th.0 Request processed in 260us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772030.653915:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790772030.654335:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8447:1877760428504960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772030.654407:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b280e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8447:1877760428505088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772030.654452:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772030.654477:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772030.654747:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428505088 00000100:00100000:3.0:1790772030.654766:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428505088 00000100:00100000:3.0:1790772030.654801:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790772030.654809:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:8447:x1877760428505088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772030.655021:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:8447:x1877760428505088:12345-0@lo:502:llog_process_th.0 Request processed in 212us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772030.655028:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790772030.655722:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b280e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8447:1877760428505088:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790772030.655771:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790772030.655851:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790772030.655869:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790772030.655883:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772030.655896:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772030.655907:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790772030.655910:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1790772030.655922:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790772030.655955:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772030.655964:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772030.655975:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772030.655994:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b280e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428505216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.656040:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772030.656333:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772030.656354:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428505216 00000100:00100000:0.0:1790772030.656359:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428505216 00000100:00100000:1.0:1790772030.656460:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790772030.656474:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+15:5820:x1877760428505216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772030.656709:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772030.656728:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b9200/0xdf68d9a7d6a8fea5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fe9e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.656755:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b9200/0xdf68d9a7d6a8fea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe9e expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.656776:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b9200/0xdf68d9a7d6a8fea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe9e expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.656786:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9200, rc 0) 00000100:00100000:1.0:1790772030.656835:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428505216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 366us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772030.656902:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b280e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428505216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772030.656918:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.656927:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772030.657002:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428505344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772030.657032:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772030.657140:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428505344 00000100:00100000:2.0:1790772030.657146:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428505344 00000100:00100000:3.0:1790772030.657191:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772030.660492:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790772030.664691:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790772030.664722:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428505344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.671962:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428505344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7243us (14915us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772030.671980:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790772030.672132:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428505344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.672271:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428505472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.672354:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772030.672397:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772030.672580:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428505472 00000100:00100000:1.0:1790772030.672589:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428505472 00000100:00100000:1.0:1790772030.672648:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790772030.672656:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428505472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772030.672887:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428505472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772030.672895:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790772030.673287:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428505472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.673842:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8448:1877760428505600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772030.673896:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772030.673931:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772030.673982:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428505600 00000100:00100000:3.0:1790772030.673989:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428505600 00000100:00100000:3.0:1790772030.674032:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790772030.674041:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:8448:x1877760428505600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772030.674252:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:8448:x1877760428505600:12345-0@lo:502:llog_process_th.0 Request processed in 213us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772030.674259:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790772030.674460:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8448:1877760428505600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772030.674497:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772030.674513:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772030.674515:0:8448:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790772030.674520:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790772030.674540:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8448:1877760428505728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772030.674618:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772030.674634:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772030.675034:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428505728 00000100:00100000:1.0:1790772030.675042:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428505728 00000100:00100000:1.0:1790772030.675086:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790772030.675094:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:8448:x1877760428505728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772030.675294:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:8448:x1877760428505728:12345-0@lo:502:llog_process_th.0 Request processed in 200us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772030.675429:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790772030.675738:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8448:1877760428505728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772030.675765:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772030.675772:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772030.675774:0:8448:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790772030.675778:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1790772030.675938:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1790772030.675961:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790772030.675973:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.675985:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772030.675995:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790772030.675998:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df258965000 from 39 10000000:01000000:3.0:1790772030.676001:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790772030.676036:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.676043:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.676064:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772030.676084:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428505856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772030.676126:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772030.676230:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772030.681677:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428505856 00000100:00100000:2.0:1790772030.681697:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428505856 00000100:00100000:2.0:1790772030.682009:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790772030.682021:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428505856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772030.682044:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772030.682069:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8feb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8feac expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772030.682104:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8feb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8feac expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772030.682118:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8feb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8feac expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772030.682129:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241391600, rc 0) 00000100:00100000:2.0:1790772030.682244:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428505856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (6116us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772030.682252:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790772030.689463:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428505856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772030.690254:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772030.690271:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772030.690778:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428505984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.690853:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772030.690900:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772030.691105:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428505984 00000100:00100000:3.0:1790772030.691115:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428505984 00000100:00100000:3.0:1790772030.693112:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790772030.693137:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428505984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772030.694959:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428505984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1825us (4097us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772030.694973:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790772030.695888:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428505984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.695960:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428506112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.696106:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772030.696159:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772030.696282:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428506112 00000100:00100000:2.0:1790772030.696290:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428506112 00000100:00100000:2.0:1790772030.696367:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790772030.696377:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428506112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772030.697135:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428506112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 757us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772030.697155:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790772030.697323:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428506112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.698542:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8449:1877760428506240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772030.699739:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772030.699792:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1790772030.699863:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428506240 00000100:00100000:3.0:1790772030.699871:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428506240 00000100:00100000:3.0:1790772030.699933:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790772030.699943:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:8449:x1877760428506240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772030.700506:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:8449:x1877760428506240:12345-0@lo:502:llog_process_th.0 Request processed in 563us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772030.700515:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790772030.700877:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8449:1877760428506240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772030.700948:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8449:1877760428506368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772030.701065:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772030.701104:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4900 going to sleep for 11 seconds 00000100:00100000:2.0:1790772030.701262:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428506368 00000100:00100000:2.0:1790772030.701268:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428506368 00000100:00100000:2.0:1790772030.701328:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790772030.701337:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:8449:x1877760428506368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772030.701863:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:8449:x1877760428506368:12345-0@lo:502:llog_process_th.0 Request processed in 525us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772030.701871:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790772030.702095:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8449:1877760428506368:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790772030.702120:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790772030.702421:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790772030.702440:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790772030.702452:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.702464:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772030.702579:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790772030.702583:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1790772030.702586:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790772030.702682:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.702691:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.702701:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772030.702723:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428506496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772030.702765:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772030.702795:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2540980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772030.702901:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428506496 00000100:00100000:0.0:1790772030.702908:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428506496 00000100:00100000:0.0:1790772030.702942:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790772030.702952:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428506496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772030.702966:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772030.702980:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f8d8000/0xdf68d9a7d6a8fec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8feba expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772030.703132:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f8d8000/0xdf68d9a7d6a8fec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8feba expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772030.703212:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f8d8000/0xdf68d9a7d6a8fec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8feba expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772030.703223:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8000, rc 0) 00000100:00100000:0.0:1790772030.703273:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428506496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 322us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772030.703289:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790772030.703439:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428506496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772030.703454:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772030.703463:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772030.709800:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428506624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772030.709889:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772030.709985:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27ac75d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772030.712119:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428506624 00000100:00100000:3.0:1790772030.712136:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428506624 00000100:00100000:3.0:1790772030.712275:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790772030.712286:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428506624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772030.715025:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428506624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2730us (5124us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772030.715050:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790772030.717378:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428506624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772030.717456:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428506752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772030.719473:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772030.719532:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27ac75d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772030.720391:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428506752 00000100:00100000:0.0:1790772030.720403:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428506752 00000100:00100000:0.0:1790772030.720461:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790772030.720473:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428506752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.720773:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428506752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 301us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772030.720781:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790772030.721658:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428506752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772030.722132:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8450:1877760428506880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772030.722216:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.722262:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772030.722387:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428506880 00000100:00100000:2.0:1790772030.722394:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428506880 00000100:00100000:2.0:1790772030.722436:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790772030.722444:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8450:x1877760428506880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772030.722757:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8450:x1877760428506880:12345-0@lo:502:llog_process_th.0 Request processed in 312us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772030.722765:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790772030.723143:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8450:1877760428506880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790772030.723174:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772030.723185:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772030.723188:0:8450:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790772030.723195:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790772030.723225:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8450:1877760428507008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772030.723262:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.723302:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772030.723363:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428507008 00000100:00100000:0.0:1790772030.723368:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428507008 00000100:00100000:0.0:1790772030.723398:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790772030.723406:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8450:x1877760428507008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772030.723635:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8450:x1877760428507008:12345-0@lo:502:llog_process_th.0 Request processed in 229us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772030.723642:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790772030.726390:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8450:1877760428507008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790772030.726447:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772030.726459:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772030.726462:0:8450:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790772030.726468:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790772030.726738:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1790772030.726763:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790772030.726776:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772030.726789:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772030.726800:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790772030.726803:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df258e04d40 from 1 10000000:01000000:0.0:1790772030.726805:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790772030.726843:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d9200/0xdf68d9a7d6a8fec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772030.726859:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f8d9200/0xdf68d9a7d6a8fec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772030.726870:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f8d9200/0xdf68d9a7d6a8fec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772030.726892:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428507136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772030.726962:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772030.727008:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772030.728061:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428507136 00000100:00100000:1.0:1790772030.728074:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428507136 00000100:00100000:1.0:1790772030.728175:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790772030.728187:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428507136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772030.728205:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772030.728223:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b8000/0xdf68d9a7d6a8fecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fec8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.728251:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b8000/0xdf68d9a7d6a8fecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fec8 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.728264:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b8000/0xdf68d9a7d6a8fecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fec8 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.728284:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8000, rc 0) 00000100:00100000:1.0:1790772030.728377:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428507136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772030.728384:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790772030.729493:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b283480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428507136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772030.729519:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f8d9200/0xdf68d9a7d6a8fec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fecf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.729531:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f8d9200/0xdf68d9a7d6a8fec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fecf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772030.729651:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428507264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772030.729710:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772030.729745:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc900 going to sleep for 11 seconds 00000100:00100000:2.0:1790772030.729861:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428507264 00000100:00100000:2.0:1790772030.729867:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428507264 00000100:00100000:2.0:1790772030.729911:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790772030.729920:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428507264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772030.730209:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428507264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (498us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790772030.730217:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790772030.730514:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428507264:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1790772030.730578:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790772030.730588:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d9200/0xdf68d9a7d6a8fec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fecf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772030.730686:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f8d9200/0xdf68d9a7d6a8fec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fecf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772031.519918:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772031.529251:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772031.529438:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772031.530999:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412750336 00000100:00100000:1.0:1790772031.531015:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412750336 00000100:00100000:1.0:1790772031.531132:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:1.0:1790772031.531159:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412750336:12345-192.168.206.27@tcp:400: 00000100:00100000:1.0:1790772031.531262:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412750336:12345-192.168.206.27@tcp:400: Request processed in 106us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772031.531270:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00080000:2.0:1790772031.531825:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772031.534279:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412750208 00000100:00100000:3.0:1790772031.534297:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412750208 00000100:00100000:3.0:1790772031.534381:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 164 00000100:00100000:3.0:1790772031.534392:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:2347:x1877760412750208:12345-192.168.206.27@tcp:400: 00000100:00100000:3.0:1790772031.537791:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:2347:x1877760412750208:12345-192.168.206.27@tcp:400: Request processed in 3384us (8538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772031.537808:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 164 00000100:00100000:1.0:1790772031.541790:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772031.541962:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772031.542810:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412750592 00000100:00100000:0.0:1790772031.542826:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412750592 00000100:00100000:0.0:1790772031.542906:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412750464 00000100:00100000:0.0:1790772031.542909:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412750464 00000100:00100000:0.0:1790772031.542930:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:0.0:1790772031.542939:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412750592:12345-192.168.206.27@tcp:400: 00000100:00100000:0.0:1790772031.543024:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412750592:12345-192.168.206.27@tcp:400: Request processed in 85us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772031.543031:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:0.0:1790772031.543065:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:0.0:1790772031.543078:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412750464:12345-192.168.206.27@tcp:400: 00000100:00100000:0.0:1790772031.543102:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412750464:12345-192.168.206.27@tcp:400: Request processed in 27us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772031.543109:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00080000:1.0:1790772031.546254:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772031.546268:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790772032.546879:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772033.568363:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772034.592068:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772034.599372:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772034.600520:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412750720 00000100:00100000:0.0:1790772034.600541:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412750720 00000100:00100000:0.0:1790772034.600652:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 165 00000100:00100000:0.0:1790772034.600681:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:5589:x1877760412750720:12345-192.168.206.27@tcp:101: 00010000:00010000:0.0:1790772034.600704:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772034.600725:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f8d9c00/0xdf68d9a7d6a8fed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f22690f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772034.600760:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f8d9c00/0xdf68d9a7d6a8fed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22690f expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772034.600933:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f8d9c00/0xdf68d9a7d6a8fed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22690f expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772034.600944:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9c00, rc 0) 00000100:00100000:0.0:1790772034.601059:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5589:x1877760412750720:12345-192.168.206.27@tcp:101: Request processed in 380us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772034.601066:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 165 00000100:00100000:0.0:1790772034.613201:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772034.613301:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412750848 00000100:00100000:3.0:1790772034.613314:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412750848 00000100:00100000:3.0:1790772034.613376:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 166 00000100:00100000:3.0:1790772034.613387:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5589:x1877760412750848:12345-192.168.206.27@tcp:501: 00000100:00100000:3.0:1790772034.613897:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5589:x1877760412750848:12345-192.168.206.27@tcp:501: Request processed in 510us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772034.613907:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 166 00000100:00100000:1.0:1790772034.620832:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772034.621090:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412750976 00000100:00100000:0.0:1790772034.621103:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412750976 00000100:00100000:0.0:1790772034.621168:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 167 00000100:00100000:0.0:1790772034.621186:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5589:x1877760412750976:12345-192.168.206.27@tcp:503: 00000100:00100000:0.0:1790772034.621542:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5589:x1877760412750976:12345-192.168.206.27@tcp:503: Request processed in 356us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772034.621580:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 167 00000100:00100000:0.0:1790772034.627827:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772034.630446:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412751104 00000100:00100000:3.0:1790772034.630466:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412751104 00000100:00100000:0.0:1790772034.631161:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 168 00000100:00100000:0.0:1790772034.631441:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:6081:x1877760412751104:12345-192.168.206.27@tcp:502: 00000100:00100000:0.0:1790772034.631843:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:6081:x1877760412751104:12345-192.168.206.27@tcp:502: Request processed in 669us (4030us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772034.631860:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 168 00000100:00100000:3.0:1790772034.634765:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772034.634872:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412751232 00000100:00100000:1.0:1790772034.634884:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412751232 00000100:00100000:1.0:1790772034.634945:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 169 00000100:00100000:1.0:1790772034.634956:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:6081:x1877760412751232:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790772034.635315:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:6081:x1877760412751232:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 360us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772034.635324:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 169 00000100:00100000:1.0:1790772034.668805:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772034.669045:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412751360 00000100:00100000:0.0:1790772034.669058:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412751360 00000100:00100000:0.0:1790772034.669125:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 170 00000100:00100000:0.0:1790772034.669135:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5589:x1877760412751360:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772034.669157:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772034.669349:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f8d9800/0xdf68d9a7d6a8fedd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226916 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772034.669386:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f8d9800/0xdf68d9a7d6a8fedd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226916 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772034.669400:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f8d9800/0xdf68d9a7d6a8fedd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226916 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772034.669412:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9800, rc 0) 00000100:00100000:0.0:1790772034.669486:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5589:x1877760412751360:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 352us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772034.669493:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 170 00000100:00100000:0.0:1790772034.675450:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772034.682019:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412751488 00000100:00100000:2.0:1790772034.682042:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412751488 00000100:00100000:2.0:1790772034.682128:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 171 00000100:00100000:2.0:1790772034.682140:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5589:x1877760412751488:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772034.682512:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5589:x1877760412751488:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 373us (7076us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790772034.682522:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 171 00000100:00100000:0.0:1790772035.039915:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428507392:0@lo:400:kworker.0 00000100:00100000:1.0:1790772035.039955:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428507520:0@lo:400:kworker.0 00000100:00100000:2.0:1790772035.040031:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428507776:0@lo:400:kworker.0 00000100:00100000:3.0:1790772035.040182:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428507648:0@lo:400:kworker.0 00000100:00100000:1.0:1790772035.040538:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772035.043803:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428508032:0@lo:400:kworker.0 00000100:00100000:1.0:1790772035.043883:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772035.043978:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428508032 00000100:00100000:1.0:1790772035.043988:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428508032 00000100:00100000:1.0:1790772035.044068:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790772035.044079:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428508032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772035.044147:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428508032:12345-0@lo:400:kworker.0 Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772035.044154:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790772035.044178:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790772035.044210:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3e8e00 x1877760428508032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772035.044226:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428508032:0@lo:400:kworker.0 00000100:00100000:1.0:1790772035.044271:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428507520 00000100:00100000:1.0:1790772035.044276:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428507520 00000100:00100000:1.0:1790772035.044321:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790772035.044328:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428507520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772035.044364:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428507520:12345-0@lo:400:kworker.0 Request processed in 37us (3827us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772035.044370:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790772035.044394:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428507520:0@lo:400:kworker.0 00000100:00100000:0.0:1790772035.046607:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772035.046699:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428507392 00000100:00100000:0.0:1790772035.046703:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428507904:0@lo:400:kworker.0 00000100:00100000:1.0:1790772035.046709:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428507392 00000100:00100000:1.0:1790772035.046758:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790772035.046763:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772035.046766:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428507392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772035.046788:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428507904 00000100:00100000:0.0:1790772035.046791:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428507904 00000100:00100000:1.0:1790772035.046826:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428507392:12345-0@lo:400:kworker.0 Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772035.046833:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790772035.046840:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790772035.046846:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428507904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772035.046878:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428507904:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00080000:1.0:1790772035.046881:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772035.046884:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790772035.046912:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428507904:0@lo:400:kworker.0 00000100:00100000:0.0:1790772035.046947:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428507392:0@lo:400:kworker.0 00000100:00100000:2.0:1790772035.047063:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772035.049725:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428507776 00000100:00100000:0.0:1790772035.049744:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428507776 00000100:00100000:3.0:1790772035.049955:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772035.050003:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428508160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772035.050048:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772035.050095:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428508160 00000100:00100000:3.0:1790772035.050099:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428508160 00000100:00100000:3.0:1790772035.050165:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772035.050174:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1877760428508160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772035.050226:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772035.050682:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428507648 00000100:00100000:2.0:1790772035.050687:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428507648 00000100:00100000:0.0:1790772035.050808:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790772035.050817:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1877760428507776:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790772035.051462:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772035.051469:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772035.055694:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790772035.055713:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428507648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772035.055801:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1877760428507776:12345-0@lo:400:kworker.0 Request processed in 4982us (8734us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772035.055814:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772035.055834:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428507648:12345-0@lo:400:kworker.0 Request processed in 126us (5881us total) trans 0 rc 0/0 00010000:00080000:0.0:1790772035.057922:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3ea680 x1877760428507776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772035.057947:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428507776:0@lo:400:kworker.0 00000100:00100000:0.0:1790772035.058009:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428507648:0@lo:400:kworker.0 00000100:00100000:3.0:1790772035.058173:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428508160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7996us (8120us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772035.058185:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772035.058202:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1790772035.065887:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747d6680 x1877760428508160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772035.065923:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428508160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772035.551833:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428508288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772035.551915:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772035.551992:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428508288 00000100:00100000:3.0:1790772035.552014:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428508288 00000100:00100000:3.0:1790772035.552064:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772035.552073:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428508288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772035.552117:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772035.552162:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428508288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772035.552184:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1790772035.552231:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3eb100 x1877760428508288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772035.552251:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428508288:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772035.618342:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790772035.797406:0:8488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd85924cf0 20000000:00000080:3.0:1790772035.797427:0:8488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df141216000 uarg=0000000000000000 20000000:01000000:3.0:1790772035.797468:0:8488:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790772035.797474:0:8488:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790772035.797480:0:8488:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790772035.798427:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1790772035.798735:0:8488:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1790772035.810368:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1790772035.811824:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1790772035.811924:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1790772035.811944:0:8488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790772035.811965:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.811983:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2414a2a00/0xdf68d9a7d6a8fc59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc52 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.811991:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241390800/0xdf68d9a7d6a8fcbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fcb4 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.811997:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a8fd86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fd7f expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.812006:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fe43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268de expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.812013:0:8488:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.812052:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fe43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268de expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.812068:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fe43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268de expref: 9 pid: 5818 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772035.812082:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1877760428508416:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772035.812192:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a8fd86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd7f expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.812201:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a8fd86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd7f expref: 18 pid: 5818 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772035.812224:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1877760428508544:0@lo:104: 00000100:00100000:3.0:1790772035.812265:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772035.812319:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241390800/0xdf68d9a7d6a8fcbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcb4 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.812328:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241390800/0xdf68d9a7d6a8fcbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcb4 expref: 18 pid: 5816 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772035.812337:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1877760428508672:0@lo:104: 00000100:00100000:3.0:1790772035.812363:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772035.812397:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2414a2a00/0xdf68d9a7d6a8fc59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc52 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.812419:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df2414a2a00/0xdf68d9a7d6a8fc59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc52 expref: 18 pid: 5816 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772035.812428:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1877760428508800:0@lo:104: 00000100:00100000:3.0:1790772035.812447:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25089af00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772035.812597:0:5807:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790772035.812613:0:5806:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:2.0:1790772035.812693:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428508544 00000100:00100000:2.0:1790772035.812705:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428508544 00000100:00100000:2.0:1790772035.812753:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428508672 00000100:00100000:2.0:1790772035.812757:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428508672 00000100:00100000:2.0:1790772035.812775:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790772035.812786:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:8488:x1877760428508544:12345-0@lo:104: 00010000:00010000:2.0:1790772035.812804:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.816329:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790772035.816351:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:8488:x1877760428508544:12345-0@lo:104: Request processed in 3561us (4080us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772035.816366:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790772035.816411:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790772035.816425:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274592c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:8488:x1877760428508672:12345-0@lo:104: 00010000:00010000:2.0:1790772035.816445:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.816751:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790772035.816758:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274592c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:8488:x1877760428508672:12345-0@lo:104: Request processed in 339us (4394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772035.816766:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1790772035.816811:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772035.816818:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.816836:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772035.816840:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.816849:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772035.816857:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772035.816863:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790772035.816907:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.816914:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772035.816943:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.816951:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df2414a3200/0xdf68d9a7d6a8fd7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fd86 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.816965:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772035.816969:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.816977:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772035.816980:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.816997:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772035.817012:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1877760428508544:0@lo:104: 00000100:00100000:3.0:1790772035.817028:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1877760428508672:0@lo:104: 00010000:00010000:0.0:1790772035.817256:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1790772035.817302:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772035.817309:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790772035.817328:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.817333:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790772035.817387:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428509056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772035.817442:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790772035.817520:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.817528:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df241391a00/0xdf68d9a7d6a8fcb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fcbb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.817541:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772035.817543:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772035.817545:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772035.817586:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428508928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772035.817616:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772035.817684:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428509056 00000100:00100000:2.0:1790772035.817692:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428509056 00010000:00010000:2.0:1790772035.817724:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241390800/0xdf68d9a7d6a8fcbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcb4 expref: 19 pid: 5816 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772035.817751:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428508928 00000100:00100000:2.0:1790772035.817754:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428508928 00010000:00010000:2.0:1790772035.817776:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a8fd86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd7f expref: 20 pid: 5818 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772035.817793:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790772035.817801:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+20:3293:x1877760428509056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772035.817814:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772035.817819:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241390800/0xdf68d9a7d6a8fcbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcb4 expref: 20 pid: 5816 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.817829:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241390800/0xdf68d9a7d6a8fcbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcb4 expref: 20 pid: 5816 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.817845:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241390800/0xdf68d9a7d6a8fcbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fcb4 expref: 20 pid: 5816 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772035.817860:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772035.817947:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790772035.817962:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428508928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790772035.817980:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772035.817990:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a8fd86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd7f expref: 19 pid: 5818 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.818017:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a8fd86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd7f expref: 19 pid: 5818 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.818047:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a8fd86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fd7f expref: 19 pid: 5818 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.818062:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772035.818125:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:3296:x1877760428508928:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772035.818144:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772035.824569:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772035.824632:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428508800 00000100:00100000:1.0:1790772035.824643:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428508800 00000100:00100000:1.0:1790772035.824712:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790772035.824724:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:8488:x1877760428508800:12345-0@lo:104: 00010000:00010000:1.0:1790772035.824744:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df28204f600/0xdf68d9a7d6a8fc52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.824846:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772035.824853:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:8488:x1877760428508800:12345-0@lo:104: Request processed in 132us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772035.824863:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790772035.824904:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1877760428508800:0@lo:104: 00010000:00010000:1.0:1790772035.825741:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772035.825752:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df28204f600/0xdf68d9a7d6a8fc52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.825762:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df28204f600 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772035.825767:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df28204f600/0xdf68d9a7d6a8fc52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.825778:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df28204f600/0xdf68d9a7d6a8fc52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772035.825786:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df28204f600/0xdf68d9a7d6a8fc52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772035.825808:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790772035.825860:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df28204f600/0xdf68d9a7d6a8fc52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772035.825877:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1877760428508416:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772035.825915:0:8488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772035.825960:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772035.826016:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412751616 00000100:00100000:3.0:1790772035.826024:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412751616 00010000:00010000:3.0:1790772035.826057:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fe43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268de expref: 10 pid: 5818 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772035.826104:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:3.0:1790772035.826113:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b280700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2348:x1877760412751616:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772035.826140:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772035.826147:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fe43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268de expref: 10 pid: 5818 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.826159:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fe43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268de expref: 10 pid: 5818 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.826175:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240031600/0xdf68d9a7d6a8fe43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268de expref: 10 pid: 5818 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772035.826201:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772035.826258:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b280700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:2348:x1877760412751616:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 145us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772035.826266:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00010000:00010000:1.0:1790772035.826422:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772035.826453:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df28204f600/0xdf68d9a7d6a8fc52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.826813:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df28204f600/0xdf68d9a7d6a8fc52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fc59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.826834:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772035.826836:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772035.826838:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772035.829516:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:3293:x1877760428509056:12345-0@lo:103:ldlm_bl.0 Request processed in 11706us (12065us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772035.829532:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790772035.829622:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428509184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772035.829688:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772035.829944:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428508928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772035.830047:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428509056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772035.832475:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428509184 00000100:00100000:1.0:1790772035.832495:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428509184 00010000:00010000:1.0:1790772035.832612:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2414a2a00/0xdf68d9a7d6a8fc59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc52 expref: 17 pid: 5816 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772035.832657:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772035.832668:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:3294:x1877760428509184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772035.832685:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772035.832691:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2414a2a00/0xdf68d9a7d6a8fc59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc52 expref: 17 pid: 5816 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832705:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2414a2a00/0xdf68d9a7d6a8fc59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc52 expref: 17 pid: 5816 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832724:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a2a00/0xdf68d9a7d6a8fc59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fc52 expref: 17 pid: 5816 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832755:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832765:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832784:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832790:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832798:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832805:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832811:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df28204e400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772035.832816:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832825:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832840:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772035.832851:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772035.832929:0:8488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772035.832936:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3294:x1877760428509184:12345-0@lo:103:ldlm_bl.0 Request processed in 270us (3246us total) trans 0 rc 0/0 00010000:00010000:0.0:1790772035.832938:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772035.832945:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df28204e400/0xdf68d9a7d6a8fee4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772035.832953:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772035.833008:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428509184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772036.585111:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772036.585366:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412751744 00000100:00100000:2.0:1790772036.585457:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412751744 00000100:00100000:3.0:1790772036.585740:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 173 00000100:00100000:3.0:1790772036.585754:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:5589:x1877760412751744:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772036.585777:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772036.585800:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8feeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f22691d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772036.585832:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8feeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22691d expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772036.585844:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8feeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22691d expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772036.585855:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2400, rc 0) 00000100:00100000:3.0:1790772036.585933:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5589:x1877760412751744:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 182us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772036.585941:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 173 00000100:00100000:3.0:1790772036.589064:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772036.592506:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412751872 00000100:00100000:0.0:1790772036.592525:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412751872 00000100:00100000:0.0:1790772036.592610:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 174 00000100:00100000:0.0:1790772036.592622:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5589:x1877760412751872:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772036.592981:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5589:x1877760412751872:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 360us (3930us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772036.592990:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 174 00000100:00100000:0.0:1790772036.595480:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772036.595662:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412752000 00000100:00100000:1.0:1790772036.595674:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412752000 00000100:00100000:1.0:1790772036.595737:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 175 00000100:00100000:1.0:1790772036.595749:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5589:x1877760412752000:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772036.596168:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:5589:x1877760412752000:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 420us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772036.596177:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 175 00000100:00100000:1.0:1790772036.599255:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772036.599721:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412752128 00000100:00100000:3.0:1790772036.599734:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412752128 00000100:00100000:3.0:1790772036.599824:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 176 00000100:00100000:3.0:1790772036.599836:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:6138:x1877760412752128:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772036.600138:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:6138:x1877760412752128:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 304us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772036.600146:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 176 00000100:00100000:2.0:1790772036.606713:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772036.609053:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412752256 00000100:00100000:3.0:1790772036.609072:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412752256 00000100:00100000:3.0:1790772036.609144:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 177 00000100:00100000:3.0:1790772036.609156:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:6138:x1877760412752256:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772036.609475:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:6138:x1877760412752256:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 320us (2775us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772036.609485:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 177 00010000:00010000:2.0:1790772036.639835:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772036.649921:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772036.649971:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772036.650001:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412752512 00000100:00100000:1.0:1790772036.650010:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772036.650017:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412752512 00000100:00100000:1.0:1790772036.650046:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412752384 00000100:00100000:1.0:1790772036.650057:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412752384 00000100:00100000:3.0:1790772036.650100:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412752640 00000100:00100000:3.0:1790772036.650107:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412752640 00000100:00100000:1.0:1790772036.650132:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:3.0:1790772036.650144:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:1.0:1790772036.650154:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412752384:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772036.650167:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412752512:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772036.650252:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412752384:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 106us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772036.650262:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:1.0:1790772036.650311:0:6678:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790772036.650321:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412752512:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 160us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772036.650321:0:6678:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1790772036.650341:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772036.650348:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772036.650350:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772036.650428:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:1.0:1790772036.650656:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:1.0:1790772036.650666:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412752640:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772036.650726:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412752640:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 61us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772036.650733:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 10000000:01000000:2.0:1790772037.156290:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790772037.156300:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df273e99800 from 4 10000000:01000000:2.0:1790772037.156306:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790772037.156367:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772037.156381:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772037.156394:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772037.156424:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428509312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772037.156502:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772037.156592:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27ac75480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772037.156708:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428509312 00000100:00100000:3.0:1790772037.156719:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428509312 00000100:00100000:3.0:1790772037.156836:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790772037.156847:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428509312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772037.156863:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772037.156878:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fef9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8fef2 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772037.156920:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fef2 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772037.156930:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fef2 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772037.156941:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2e00, rc 0) 00000100:00100000:3.0:1790772037.156993:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428509312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772037.157000:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790772037.157092:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428509312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772037.157110:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772037.157119:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772037.157179:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428509440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772037.157224:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772037.165909:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27ac75480 going to sleep for 11 seconds 00000100:00100000:0.0:1790772037.165986:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428509440 00000100:00100000:0.0:1790772037.165999:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428509440 00000100:00100000:0.0:1790772037.166350:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790772037.166362:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428509440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772037.166742:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428509440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 382us (9516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772037.166751:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790772037.168237:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428509440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772037.168322:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428509568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772037.168409:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772037.169180:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27ac75480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772037.174353:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428509568 00000100:00100000:3.0:1790772037.174373:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428509568 00000100:00100000:2.0:1790772037.174617:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790772037.174629:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428509568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772037.174955:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428509568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 328us (6545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772037.174964:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790772037.175178:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428509568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772037.175672:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8546:1877760428509696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772037.175737:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772037.175793:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772037.175896:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428509696 00000100:00100000:2.0:1790772037.175903:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428509696 00000100:00100000:2.0:1790772037.175949:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790772037.175958:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:8546:x1877760428509696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772037.176237:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:8546:x1877760428509696:12345-0@lo:502:llog_process_th.0 Request processed in 280us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772037.176246:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790772037.177215:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8546:1877760428509696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790772037.177253:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772037.177264:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772037.177266:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790772037.177273:0:8546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df273e99800 00000020:00000080:1.0:1790772037.177286:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790772037.177376:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8546:1877760428509824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772037.177447:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772037.177484:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772037.182516:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428509824 00000100:00100000:2.0:1790772037.182537:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428509824 00000100:00100000:2.0:1790772037.182646:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790772037.182660:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:8546:x1877760428509824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772037.182981:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:8546:x1877760428509824:12345-0@lo:502:llog_process_th.0 Request processed in 321us (5531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772037.182992:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790772037.186698:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8546:1877760428509824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772037.186747:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772037.186756:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772037.186766:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790772037.186772:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790772037.191582:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790772037.191634:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772037.191652:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.191668:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772037.191680:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790772037.191684:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df242cf1800 from 4 10000000:01000000:1.0:1790772037.191687:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772037.191742:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.191752:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.191765:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772037.191796:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428509952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772037.191873:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772037.191923:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772037.191968:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428509952 00000100:00100000:0.0:1790772037.191982:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428509952 00000100:00100000:0.0:1790772037.192049:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1790772037.192059:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428509952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772037.192077:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772037.192094:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f8d8800/0xdf68d9a7d6a8ff07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8ff00 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772037.192121:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f8d8800/0xdf68d9a7d6a8ff07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff00 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772037.192131:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f8d8800/0xdf68d9a7d6a8ff07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff00 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772037.192140:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8800, rc 0) 00000100:00100000:0.0:1790772037.192233:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428509952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772037.192241:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790772037.193582:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428509952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772037.193612:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.193625:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772037.193719:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428510080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772037.193781:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772037.193821:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772037.193844:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428510080 00000100:00100000:1.0:1790772037.193851:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428510080 00000100:00100000:1.0:1790772037.193896:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790772037.193905:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428510080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772037.195459:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428510080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1545us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772037.195482:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790772037.195574:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428510080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772037.195628:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428510208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772037.195672:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772037.195704:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772037.195720:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428510208 00000100:00100000:1.0:1790772037.195726:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428510208 00000100:00100000:1.0:1790772037.195759:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790772037.195767:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428510208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772037.195911:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428510208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772037.195917:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790772037.195952:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428510208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772037.198331:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8551:1877760428510336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772037.198485:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772037.198524:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df245aad180 going to sleep for 11 seconds 00000100:00100000:1.0:1790772037.199156:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428510336 00000100:00100000:1.0:1790772037.199167:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428510336 00000100:00100000:1.0:1790772037.199224:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790772037.199236:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8551:x1877760428510336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772037.200731:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8551:x1877760428510336:12345-0@lo:502:llog_process_th.0 Request processed in 1490us (2307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772037.200745:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790772037.200845:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8551:1877760428510336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790772037.200885:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772037.200897:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772037.200899:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790772037.200917:0:8551:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df242cf1800 00000020:00000080:1.0:1790772037.200920:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790772037.203483:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8551:1877760428510464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772037.203578:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772037.203621:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428510464 00000100:00100000:1.0:1790772037.203629:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428510464 00000100:00100000:1.0:1790772037.203680:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790772037.203689:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8551:x1877760428510464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772037.203920:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:8551:x1877760428510464:12345-0@lo:502:llog_process_th.0 Request processed in 231us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772037.203930:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790772037.203994:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772037.204020:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8551:1877760428510464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790772037.205215:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772037.205231:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772037.205233:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790772037.205240:0:8551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790772037.205335:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790772037.205364:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772037.205379:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.205394:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772037.205406:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790772037.205410:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df258965000 from 4 10000000:01000000:1.0:1790772037.206133:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772037.206180:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.206197:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.206210:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772037.206237:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428510592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772037.206314:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772037.206352:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772037.206378:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428510592 00000100:00100000:1.0:1790772037.206387:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428510592 00000100:00100000:1.0:1790772037.207173:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790772037.207185:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428510592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772037.207202:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772037.207219:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8ff0e expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.207247:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff0e expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.207260:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff0e expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.207271:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9e00, rc 0) 00000100:00100000:1.0:1790772037.207340:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428510592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772037.207347:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790772037.208577:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428510592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772037.208609:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.208622:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772037.208701:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428510720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772037.208749:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772037.208793:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772037.208869:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428510720 00000100:00100000:0.0:1790772037.208880:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428510720 00000100:00100000:0.0:1790772037.208987:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790772037.208999:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428510720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772037.209351:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428510720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772037.209361:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790772037.209421:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428510720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772037.209495:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428510848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772037.209541:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772037.209606:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2464a0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772037.209623:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428510848 00000100:00100000:0.0:1790772037.209627:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428510848 00000100:00100000:0.0:1790772037.209653:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790772037.209659:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428510848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772037.209880:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428510848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772037.209888:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790772037.209928:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428510848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772037.210106:0:8553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8553:1877760428510976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772037.210147:0:8553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772037.210166:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428510976 00000100:00100000:0.0:1790772037.210170:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428510976 00000100:00100000:0.0:1790772037.210193:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790772037.210199:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:8553:x1877760428510976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772037.210365:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:8553:x1877760428510976:12345-0@lo:502:llog_process_th.0 Request processed in 164us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772037.210372:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790772037.210402:0:8553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2464a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772037.210414:0:8553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8553:1877760428510976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772037.210436:0:8553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772037.210445:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772037.210453:0:8553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790772037.210461:0:8553:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df258965000 00000020:00000080:0.0:1790772037.210463:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790772037.210938:0:8553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8553:1877760428511104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772037.210982:0:8553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772037.211009:0:8553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2464a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1790772037.211584:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428511104 00000100:00100000:1.0:1790772037.211599:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428511104 00000100:00100000:1.0:1790772037.211657:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790772037.211668:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:8553:x1877760428511104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772037.211961:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:8553:x1877760428511104:12345-0@lo:502:llog_process_th.0 Request processed in 294us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772037.211970:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1790772037.212102:0:8553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:8553:1877760428511104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772037.212144:0:8553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772037.212152:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772037.212154:0:8553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790772037.212159:0:8553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790772037.213634:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790772037.213693:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772037.213710:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772037.213727:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772037.665587:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772038.688615:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772039.718755:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772040.160214:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428511232:0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.160312:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772040.160365:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428511744:0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.160395:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772040.160426:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790772040.160431:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428511360:0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.160453:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772040.160476:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428511872:0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.160497:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772040.160530:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428511232 00000100:00100000:3.0:1790772040.160578:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428511232 00000100:00100000:3.0:1790772040.160836:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790772040.160848:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428511232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.160910:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428511232:12345-0@lo:400:kworker.0 Request processed in 63us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772040.160918:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790772040.160957:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428511744 00000100:00100000:3.0:1790772040.160961:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428511744 00000100:00100000:3.0:1790772040.160997:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428511360 00000100:00100000:3.0:1790772040.161000:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428511360 00000100:00100000:3.0:1790772040.161016:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790772040.161022:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428511744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.161055:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428511744:12345-0@lo:400:kworker.0 Request processed in 32us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772040.161060:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790772040.161071:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790772040.161077:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428511360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.161776:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428511360:12345-0@lo:400:kworker.0 Request processed in 695us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772040.161785:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790772040.161815:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428511872 00000100:00100000:3.0:1790772040.161820:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428511872 00000100:00100000:3.0:1790772040.161856:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772040.161864:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428511872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.161901:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428511872:12345-0@lo:400:kworker.0 Request processed in 38us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772040.161907:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790772040.161938:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772040.161943:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772040.161990:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428511360:0@lo:400:kworker.0 00010000:00080000:3.0:1790772040.162006:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3ea680 x1877760428511872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772040.162017:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428511872:0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.162026:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428511232:0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.162035:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428511744:0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.162105:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428511488:0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.162139:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772040.163741:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428511616:0@lo:400:kworker.0 00000100:00100000:2.0:1790772040.163827:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772040.163990:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772040.163997:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428512000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772040.164025:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772040.164062:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428511616 00000100:00100000:2.0:1790772040.164071:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428511616 00000100:00100000:2.0:1790772040.164130:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790772040.164140:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428511616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772040.164212:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428511616:12345-0@lo:400:kworker.0 Request processed in 73us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772040.164220:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790772040.164245:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428512000 00000100:00100000:2.0:1790772040.164249:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428512000 00000100:00100000:2.0:1790772040.164287:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790772040.164295:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428512000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772040.164324:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772040.164357:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428512000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772040.164364:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1790772040.164405:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3e9500 x1877760428512000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772040.164426:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428512000:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1790772040.164438:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3eb100 x1877760428511616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772040.164446:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428511616:0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.164535:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428511488 00000100:00100000:3.0:1790772040.164541:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428511488 00000100:00100000:3.0:1790772040.164587:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1790772040.164622:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790772040.164627:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772040.164779:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428511488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772040.164836:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428511488:12345-0@lo:400:kworker.0 Request processed in 242us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772040.164843:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790772040.164961:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428511488:0@lo:400:kworker.0 00000100:00100000:0.0:1790772040.672123:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428512128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772040.672205:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772040.672372:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428512128 00000100:00100000:0.0:1790772040.672382:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428512128 00000100:00100000:0.0:1790772040.672440:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790772040.672449:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428512128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772040.672490:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772040.672536:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428512128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772040.672545:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1790772040.672651:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27b281f80 x1877760428512128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772040.672671:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428512128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772040.735838:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772041.761134:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772041.775687:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772041.775729:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772041.775785:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772041.775815:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772041.775853:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412753024 00000100:00100000:1.0:1790772041.775865:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412753024 00000100:00100000:1.0:1790772041.775934:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412753152 00000100:00100000:1.0:1790772041.775937:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412753152 00000100:00100000:1.0:1790772041.775964:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:1.0:1790772041.775976:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412753024:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772041.776064:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412753024:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 90us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772041.776072:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:1.0:1790772041.776098:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:1.0:1790772041.776105:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412753152:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772041.776130:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412753152:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772041.776136:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00080000:1.0:1790772041.776156:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772041.776160:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772041.776841:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412752896 00000100:00100000:3.0:1790772041.776856:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412752896 00000100:00100000:3.0:1790772041.776978:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:3.0:1790772041.776990:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412752896:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772041.777078:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412752896:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 90us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772041.777086:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00080000:1.0:1790772041.780440:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772041.780585:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412752768 00000100:00100000:0.0:1790772041.780598:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412752768 00000100:00100000:0.0:1790772041.780662:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 194 00000100:00100000:0.0:1790772041.780686:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412752768:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772041.780790:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412752768:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 107us (5116us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772041.780797:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 194 00010000:00010000:1.0:1790772042.791767:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772042.826093:0:8789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1790772043.807971:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772044.832809:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772045.284682:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428512256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772045.284773:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772045.284939:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428512256 00000100:00100000:1.0:1790772045.284950:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428512256 00000100:00100000:1.0:1790772045.285017:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790772045.285027:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428512256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772045.285071:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772045.285124:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428512256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772045.285139:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1790772045.285163:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790772045.285300:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3e9500 x1877760428512256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772045.285322:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428512256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772045.285737:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428512384:0@lo:400:kworker.0 00000100:00100000:2.0:1790772045.285777:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772045.285807:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428512896:0@lo:400:kworker.0 00000100:00100000:2.0:1790772045.285831:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772045.285852:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772045.285857:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428512768:0@lo:400:kworker.0 00000100:00100000:2.0:1790772045.285881:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772045.285926:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428512384 00000100:00100000:2.0:1790772045.285931:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428512384 00000100:00100000:2.0:1790772045.285963:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790772045.285971:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428512384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772045.286013:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428512384:12345-0@lo:400:kworker.0 Request processed in 42us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772045.286020:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790772045.286055:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428512896 00000100:00100000:2.0:1790772045.286059:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428512896 00000100:00100000:2.0:1790772045.286094:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772045.286100:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428512896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772045.286133:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428512896:12345-0@lo:400:kworker.0 Request processed in 33us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772045.286139:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772045.286166:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428512384:0@lo:400:kworker.0 00010000:00080000:2.0:1790772045.286176:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df273fe0000 x1877760428512896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772045.286531:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428512640:0@lo:400:kworker.0 00000100:00100000:0.0:1790772045.286580:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772045.286607:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772045.286613:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428512512:0@lo:400:kworker.0 00000100:00100000:0.0:1790772045.286635:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772045.286666:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428512768 00000100:00100000:0.0:1790772045.286671:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428512768 00000100:00100000:0.0:1790772045.286704:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428512640 00000100:00100000:0.0:1790772045.286708:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428512640 00000100:00100000:0.0:1790772045.286722:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428512512 00000100:00100000:0.0:1790772045.286725:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428512512 00000100:00100000:0.0:1790772045.286738:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790772045.286744:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428512768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772045.286781:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428512768:12345-0@lo:400:kworker.0 Request processed in 36us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772045.286787:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790772045.286811:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790772045.286816:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428512640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772045.286852:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428512640:12345-0@lo:400:kworker.0 Request processed in 36us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772045.286858:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790772045.286868:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790772045.286873:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428512512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772045.286895:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428512512:12345-0@lo:400:kworker.0 Request processed in 23us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772045.286900:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790772045.286939:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428512512:0@lo:400:kworker.0 00000100:00100000:0.0:1790772045.286947:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428512640:0@lo:400:kworker.0 00000100:00100000:2.0:1790772045.287059:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428512896:0@lo:400:kworker.0 00000100:00100000:2.0:1790772045.287088:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428512768:0@lo:400:kworker.0 00000100:00080000:2.0:1790772045.287105:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790772045.287110:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772045.793415:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772045.793441:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428513024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772045.793537:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772045.794841:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428513024 00000100:00100000:2.0:1790772045.794857:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428513024 00000100:00100000:2.0:1790772045.795612:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790772045.795627:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428513024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772045.795675:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772045.795773:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428513024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772045.795782:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1790772045.796936:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26fad6300 x1877760428513024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772045.796969:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428513024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772045.857704:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772046.880234:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772046.897318:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772046.897356:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772046.897381:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772046.897406:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772046.897440:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412753280 00000100:00100000:1.0:1790772046.897453:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412753280 00000100:00100000:1.0:1790772046.897509:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 196 00000100:00100000:1.0:1790772046.897519:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412753280:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772046.897621:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412753280:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772046.897628:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 196 00000100:00100000:1.0:1790772046.897666:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412753408 00000100:00100000:1.0:1790772046.897669:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412753408 00000100:00100000:1.0:1790772046.897710:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:1.0:1790772046.897717:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412753408:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772046.897753:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412753408:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 37us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772046.897760:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:1.0:1790772046.897780:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412753536 00000100:00100000:1.0:1790772046.897792:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412753536 00000100:00100000:1.0:1790772046.897818:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412753664 00000100:00100000:1.0:1790772046.897821:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412753664 00000100:00100000:1.0:1790772046.897842:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:1.0:1790772046.897849:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2346:x1877760412753536:12345-192.168.206.27@tcp:9:kworker.0 00000020:00000080:1.0:1790772046.897877:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fe51 00000100:00080000:1.0:1790772046.897888:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8df27c046800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790772046.897929:0:6677:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790772046.899572:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+2:2346:x1877760412753536:12345-192.168.206.27@tcp:9:kworker.0 Request processed in 1691us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772046.899587:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:1.0:1790772046.899620:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:1.0:1790772046.899631:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2346:x1877760412753664:12345-192.168.206.27@tcp:9:kworker.0 00000020:00000080:1.0:1790772046.899662:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fe58 00000100:00080000:1.0:1790772046.899674:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8df27c045000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790772046.899714:0:6677:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790772046.899950:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+2:2346:x1877760412753664:12345-192.168.206.27@tcp:9:kworker.0 Request processed in 322us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772046.899957:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00010000:00010000:1.0:1790772046.900043:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772046.900979:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790772046.900988:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790772046.900991:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790772046.901009:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772047.903893:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772048.564360:0:9033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing yml_node 00010000:00010000:2.0:1790772048.938839:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772049.955610:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790772050.007448:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:3.0:1790772050.007456:0:7629:0:(genops.c:885:class_export_put()) final put ffff8df27c044000/9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:3.0:1790772050.007501:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27c044000/9271f5fd-fa87-4f6b-a8bf-0936e195e8be for lustre-OST0001 00000020:00000080:3.0:1790772050.007540:0:2348:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df27c045000 for lustre-OST0001 00000100:00100000:3.0:1790772050.399984:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772050.400018:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428513152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772050.400088:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772050.400462:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428513536:0@lo:400:kworker.0 00000100:00100000:3.0:1790772050.400715:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772050.400752:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772050.400855:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428513408:0@lo:400:kworker.0 00000100:00100000:2.0:1790772050.401006:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772050.401032:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790772050.401054:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428513280:0@lo:400:kworker.0 00000100:00100000:2.0:1790772050.401085:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772050.401096:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428513536 00000100:00100000:0.0:1790772050.401104:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428513536 00000100:00100000:2.0:1790772050.401106:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428513792:0@lo:400:kworker.0 00000100:00100000:2.0:1790772050.401129:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772050.401152:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428513408 00000100:00100000:0.0:1790772050.401156:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428513408 00000100:00100000:2.0:1790772050.401157:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428513280 00000100:00100000:2.0:1790772050.401159:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428513280 00000100:00100000:0.0:1790772050.401175:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790772050.401183:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790772050.401183:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428513536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772050.401188:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428513280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772050.401243:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428513536:12345-0@lo:400:kworker.0 Request processed in 60us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772050.401250:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790772050.401268:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790772050.401272:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428513664:0@lo:400:kworker.0 00000100:00100000:0.0:1790772050.401273:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428513408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772050.401297:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772050.401304:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428513408:12345-0@lo:400:kworker.0 Request processed in 32us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772050.401318:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790772050.401321:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428513536:0@lo:400:kworker.0 00000100:00100000:0.0:1790772050.401328:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428513664 00000100:00100000:0.0:1790772050.401330:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428513664 00000100:00100000:1.0:1790772050.401391:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428513152 00000100:00100000:1.0:1790772050.401396:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428513152 00000100:00100000:1.0:1790772050.401426:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790772050.401433:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428513152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772050.401461:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772050.401714:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428513280:12345-0@lo:400:kworker.0 Request processed in 525us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772050.401722:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1790772050.401757:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790772050.401770:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772050.401790:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428513280:0@lo:400:kworker.0 00000100:00100000:2.0:1790772050.401801:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428513408:0@lo:400:kworker.0 00000100:00100000:1.0:1790772050.410258:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428513152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8817us (10162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772050.410290:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790772050.411461:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790772050.411480:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428513664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772050.411643:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428513664:12345-0@lo:400:kworker.0 Request processed in 171us (10344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772050.411651:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1790772050.411784:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3e8380 x1877760428513152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772050.411813:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428513152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772050.411842:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428513664:0@lo:400:kworker.0 00000100:00100000:2.0:1790772050.413645:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428513792 00000100:00100000:2.0:1790772050.413658:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428513792 00000100:00100000:2.0:1790772050.413832:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790772050.413842:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428513792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772050.415033:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428513792:12345-0@lo:400:kworker.0 Request processed in 1188us (13897us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772050.415046:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1790772050.415082:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790772050.415115:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747d7480 x1877760428513792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772050.415129:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428513792:0@lo:400:kworker.0 00000100:00100000:1.0:1790772050.911909:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428513920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772050.911990:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772050.912052:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428513920 00000100:00100000:3.0:1790772050.912061:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428513920 00000100:00100000:3.0:1790772050.912116:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790772050.912126:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428513920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772050.912161:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772050.912238:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428513920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772050.912261:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1790772050.912407:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3e8380 x1877760428513920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772050.912426:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428513920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772050.976277:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790772051.474337:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:1.0:1790772051.474362:0:6704:0:(genops.c:885:class_export_put()) final put ffff8df27c047000/9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:2.0:1790772051.474538:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27c047000/9271f5fd-fa87-4f6b-a8bf-0936e195e8be for lustre-OST0000 00000020:00000080:2.0:1790772051.474617:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df27c046800 for lustre-OST0000 00010000:00010000:3.0:1790772052.003535:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772052.008284:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772052.010651:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412753792 00000100:00100000:2.0:1790772052.010664:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412753792 00000100:00100000:2.0:1790772052.010840:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 198 00000100:00100000:2.0:1790772052.010850:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412753792:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772052.010974:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412753792:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 125us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772052.010982:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 198 00000100:00100000:2.0:1790772052.014824:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772052.014926:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412753920 00000100:00100000:1.0:1790772052.014935:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412753920 00000100:00100000:1.0:1790772052.015089:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:1.0:1790772052.015100:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412753920:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772052.015167:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412753920:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 69us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772052.015175:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00080000:2.0:1790772052.015414:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1790772052.806217:0:9226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.3 00010000:00010000:2.0:1790772053.025066:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772054.048693:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772055.071788:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790772055.173983:0:9323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.3 00000100:00100000:3.0:1790772055.519751:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428514304:0@lo:400:kworker.0 00000100:00100000:3.0:1790772055.519816:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772055.519869:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772055.519875:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428514432:0@lo:400:kworker.0 00000100:00100000:3.0:1790772055.519902:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772055.519939:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428514304 00000100:00100000:3.0:1790772055.519946:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428514304 00000100:00100000:3.0:1790772055.519993:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790772055.520003:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428514304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772055.520053:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428514304:12345-0@lo:400:kworker.0 Request processed in 52us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772055.520060:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790772055.520098:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428514304:0@lo:400:kworker.0 00000100:00100000:2.0:1790772055.520174:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428514176:0@lo:400:kworker.0 00000100:00100000:2.0:1790772055.520222:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772055.520250:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428514048:0@lo:400:kworker.0 00000100:00100000:2.0:1790772055.520256:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428514688:0@lo:400:kworker.0 00000100:00100000:2.0:1790772055.520276:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772055.520280:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772055.520300:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428514560:0@lo:400:kworker.0 00000100:00100000:2.0:1790772055.520308:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428514432 00000100:00100000:2.0:1790772055.520312:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428514432 00000100:00100000:2.0:1790772055.520338:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428514688 00000100:00100000:2.0:1790772055.520341:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428514688 00000100:00100000:2.0:1790772055.520362:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772055.520368:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428514432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772055.520428:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428514176 00000100:00100000:3.0:1790772055.520432:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428514176 00000100:00100000:3.0:1790772055.520454:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790772055.520472:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428514176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772055.521641:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428514432:12345-0@lo:400:kworker.0 Request processed in 1268us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772055.521652:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772055.521689:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772055.521697:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428514688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772055.521741:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428514688:12345-0@lo:400:kworker.0 Request processed in 46us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772055.521747:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1790772055.521768:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790772055.521772:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790772055.521774:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772055.521787:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428514048 00000100:00100000:2.0:1790772055.521792:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428514048 00000100:00100000:2.0:1790772055.521824:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1790772055.521830:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428514048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772055.521863:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428514048:12345-0@lo:400:kworker.0 Request processed in 33us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772055.521869:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1790772055.521926:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772055.521938:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428514816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772055.521966:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790772055.522011:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747d6680 x1877760428514432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772055.522024:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428514432:0@lo:400:kworker.0 00000100:00100000:2.0:1790772055.522047:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428514816 00000100:00100000:2.0:1790772055.522050:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428514816 00000100:00100000:2.0:1790772055.522072:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790772055.522078:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428514816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772055.522103:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772055.522137:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428514816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772055.522149:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790772055.522175:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3e8380 x1877760428514816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772055.522202:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428514816:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790772055.522351:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e87480 x1877760428514688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772055.522361:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428514688:0@lo:400:kworker.0 00000100:00100000:2.0:1790772055.525150:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428514176:12345-0@lo:400:kworker.0 Request processed in 4667us (4916us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772055.525165:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790772055.525295:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428514176:0@lo:400:kworker.0 00000100:00100000:0.0:1790772055.525446:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772055.525650:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428514048:0@lo:400:kworker.0 00000100:00100000:3.0:1790772055.526179:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428514560 00000100:00100000:3.0:1790772055.526197:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428514560 00000100:00100000:0.0:1790772055.526449:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790772055.526468:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428514560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772055.526542:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428514560:12345-0@lo:400:kworker.0 Request processed in 85us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772055.526570:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790772055.526712:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428514560:0@lo:400:kworker.0 00000100:00080000:2.0:1790772055.526856:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772056.033442:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428514944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772056.033506:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772056.034874:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428514944 00000100:00100000:2.0:1790772056.034884:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428514944 00000100:00100000:2.0:1790772056.034930:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772056.034939:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428514944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772056.035028:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772056.035092:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428514944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772056.035100:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1790772056.035143:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3e8380 x1877760428514944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772056.035162:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428514944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772056.096234:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772057.120761:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772057.131391:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772057.131467:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772057.131658:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412754048 00000100:00100000:3.0:1790772057.131671:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412754048 00000100:00100000:3.0:1790772057.131752:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 200 00000100:00100000:3.0:1790772057.131763:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2349:x1877760412754048:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772057.131859:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2349:x1877760412754048:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 97us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772057.131867:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 200 00000100:00100000:2.0:1790772057.132080:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412754176 00000100:00100000:2.0:1790772057.132085:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412754176 00000100:00100000:2.0:1790772057.132161:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:2.0:1790772057.132170:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2350:x1877760412754176:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772057.132408:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2350:x1877760412754176:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 239us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772057.132415:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00080000:3.0:1790772057.133408:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1790772058.118712:0:9422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.3 00010000:00010000:2.0:1790772058.143767:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772059.169614:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790772059.986860:0:9470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 30 08:40:57 EDT 2026 00010000:00010000:2.0:1790772060.191860:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772060.639899:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428515456:0@lo:400:kworker.0 00000100:00100000:3.0:1790772060.639988:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772060.640067:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772060.640074:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428515328:0@lo:400:kworker.0 00000100:00100000:3.0:1790772060.640103:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772060.640141:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428515456 00000100:00100000:3.0:1790772060.640151:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428515456 00000100:00100000:3.0:1790772060.640233:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772060.640244:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428515456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772060.640309:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428515456:12345-0@lo:400:kworker.0 Request processed in 66us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772060.640316:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772060.640344:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428515328 00000100:00100000:3.0:1790772060.640348:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428515328 00000100:00100000:3.0:1790772060.640376:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790772060.640383:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428515328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772060.640415:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428515328:12345-0@lo:400:kworker.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772060.640438:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1790772060.640457:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772060.640463:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772060.640503:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428515328:0@lo:400:kworker.0 00000100:00100000:1.0:1790772060.640640:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428515072:0@lo:400:kworker.0 00000100:00100000:1.0:1790772060.640682:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772060.640710:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428515584:0@lo:400:kworker.0 00000100:00100000:1.0:1790772060.640735:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772060.640762:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790772060.640768:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428515200:0@lo:400:kworker.0 00000100:00100000:1.0:1790772060.640808:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772060.640827:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428515712:0@lo:400:kworker.0 00000100:00100000:1.0:1790772060.640849:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772060.641147:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428515072 00000100:00100000:2.0:1790772060.641164:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428515072 00000100:00100000:2.0:1790772060.641200:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1790772060.641208:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428515072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772060.641254:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428515072:12345-0@lo:400:kworker.0 Request processed in 47us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772060.641261:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1790772060.641293:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428515584 00000100:00100000:2.0:1790772060.641296:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428515584 00000100:00100000:2.0:1790772060.641325:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428515200 00000100:00100000:2.0:1790772060.641328:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428515200 00000100:00100000:2.0:1790772060.641347:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790772060.641354:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428515584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772060.641386:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428515584:12345-0@lo:400:kworker.0 Request processed in 32us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772060.641392:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790772060.641403:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772060.641409:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428515200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772060.641449:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428515200:12345-0@lo:400:kworker.0 Request processed in 41us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772060.641456:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772060.641479:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428515712 00000100:00100000:2.0:1790772060.641482:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428515712 00000100:00100000:2.0:1790772060.641508:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772060.641656:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428515840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772060.641686:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772060.641736:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428515840 00000100:00100000:1.0:1790772060.641740:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428515840 00000100:00100000:1.0:1790772060.641771:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790772060.641778:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428515840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772060.641813:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772060.641851:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428515840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772060.641857:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1790772060.641893:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64ea00 x1877760428515840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772060.641911:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428515840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772060.641965:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428515200:0@lo:400:kworker.0 00000100:00100000:1.0:1790772060.641975:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428515072:0@lo:400:kworker.0 00000100:00100000:1.0:1790772060.641985:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428515584:0@lo:400:kworker.0 00000100:00080000:1.0:1790772060.642018:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772060.642023:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772060.642204:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428515712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772060.642254:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428515712:12345-0@lo:400:kworker.0 Request processed in 740us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772060.642262:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1790772060.642620:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747d4e00 x1877760428515712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772060.642648:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428515712:0@lo:400:kworker.0 00010000:00080000:3.0:1790772060.643447:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e87480 x1877760428515456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772060.643462:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428515456:0@lo:400:kworker.0 00000100:00100000:3.0:1790772061.153254:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428515968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772061.153361:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772061.153462:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428515968 00000100:00100000:3.0:1790772061.153472:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428515968 00000100:00100000:3.0:1790772061.153526:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772061.153536:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428515968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772061.153603:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772061.153656:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428515968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772061.153664:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1790772061.153714:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64ea00 x1877760428515968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772061.153734:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428515968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772061.217258:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772062.239762:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772062.258283:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772062.258341:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772062.258443:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412754432 00000100:00100000:2.0:1790772062.258452:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412754432 00000100:00100000:2.0:1790772062.258532:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:2.0:1790772062.258542:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412754432:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772062.258632:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412754432:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 91us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772062.258640:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:0.0:1790772062.258795:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412754304 00000100:00100000:0.0:1790772062.258800:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412754304 00000100:00100000:0.0:1790772062.258836:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 202 00000100:00100000:0.0:1790772062.258851:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412754304:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772062.258887:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412754304:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 37us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772062.258893:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 202 00000100:00080000:3.0:1790772062.259185:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790772063.267066:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772064.288838:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772065.313852:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772065.760209:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428516096:0@lo:400:kworker.0 00000100:00100000:1.0:1790772065.760237:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428516352:0@lo:400:kworker.0 00000100:00100000:2.0:1790772065.760290:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772065.760292:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772065.760368:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428516224:0@lo:400:kworker.0 00000100:00100000:3.0:1790772065.760542:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428516480:0@lo:400:kworker.0 00000100:00100000:3.0:1790772065.760593:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772065.760603:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428516096 00000100:00100000:2.0:1790772065.760612:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428516096 00000100:00100000:3.0:1790772065.760622:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428516480 00000100:00100000:3.0:1790772065.760628:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428516480 00000100:00100000:2.0:1790772065.760665:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1790772065.760675:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428516096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772065.760679:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790772065.760690:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428516480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772065.760741:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428516096:12345-0@lo:400:kworker.0 Request processed in 67us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772065.760748:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428516480:12345-0@lo:400:kworker.0 Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772065.760755:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1790772065.760776:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772065.760960:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790772065.763023:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428516864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772065.763082:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772065.763146:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428516352 00000100:00100000:1.0:1790772065.763153:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428516352 00000100:00100000:1.0:1790772065.763232:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790772065.763241:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428516352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772065.763294:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428516352:12345-0@lo:400:kworker.0 Request processed in 54us (3006us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772065.763302:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790772065.763442:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428516864 00000100:00100000:3.0:1790772065.763447:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428516864 00000100:00100000:3.0:1790772065.763486:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772065.763494:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428516864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772065.763522:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772065.763588:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428516864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772065.763595:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1790772065.763613:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772065.763818:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428516096:0@lo:400:kworker.0 00000100:00100000:2.0:1790772065.763840:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428516608:0@lo:400:kworker.0 00000100:00100000:2.0:1790772065.763871:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772065.763958:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428516608 00000100:00100000:1.0:1790772065.763963:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428516608 00000100:00100000:1.0:1790772065.764002:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790772065.764009:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428516608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772065.764043:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428516608:12345-0@lo:400:kworker.0 Request processed in 35us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772065.764049:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1790772065.764109:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772065.764140:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428516608:0@lo:400:kworker.0 00010000:00080000:3.0:1790772065.764324:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64c700 x1877760428516480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772065.764335:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428516480:0@lo:400:kworker.0 00010000:00080000:1.0:1790772065.764414:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747d4700 x1877760428516864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772065.764430:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428516864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772065.764443:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428516352:0@lo:400:kworker.0 00000100:00100000:0.0:1790772065.764721:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772065.764785:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428516736:0@lo:400:kworker.0 00000100:00100000:0.0:1790772065.764812:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772065.764895:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428516736 00000100:00100000:2.0:1790772065.764900:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428516736 00000100:00100000:2.0:1790772065.764950:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790772065.764957:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428516736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772065.764999:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428516736:12345-0@lo:400:kworker.0 Request processed in 43us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772065.765005:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1790772065.765030:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64fb80 x1877760428516736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772065.765040:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428516736:0@lo:400:kworker.0 00000100:00080000:3.0:1790772065.765652:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772065.765783:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428516224 00000100:00100000:1.0:1790772065.765789:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428516224 00000100:00100000:1.0:1790772065.765834:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790772065.765849:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428516224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772065.765918:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428516224:12345-0@lo:400:kworker.0 Request processed in 73us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772065.765925:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790772065.766003:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428516224:0@lo:400:kworker.0 00000100:00100000:3.0:1790772066.273277:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428516992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772066.273342:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772066.273843:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428516992 00000100:00100000:1.0:1790772066.273852:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428516992 00000100:00100000:1.0:1790772066.273904:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790772066.273915:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428516992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772066.273948:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772066.274241:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428516992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 328us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772066.274250:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1790772066.274319:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64e300 x1877760428516992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772066.274337:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428516992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772066.339301:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772067.359886:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772067.366730:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772067.366775:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772067.366836:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412754688 00000100:00100000:1.0:1790772067.366846:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412754688 00000100:00100000:1.0:1790772067.366926:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:1.0:1790772067.366936:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412754688:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772067.367008:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412754688:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772067.367015:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00080000:3.0:1790772067.367035:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772067.367092:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412754560 00000100:00100000:2.0:1790772067.367097:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412754560 00000100:00100000:2.0:1790772067.367178:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 204 00000100:00100000:2.0:1790772067.367186:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412754560:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772067.367243:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412754560:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 58us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772067.367250:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 204 00010000:00010000:3.0:1790772068.384005:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772069.407861:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772070.431790:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772070.879747:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428517120:0@lo:400:kworker.0 00000100:00100000:0.0:1790772070.879819:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772070.881038:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428517248:0@lo:400:kworker.0 00000100:00100000:2.0:1790772070.881084:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772070.881142:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428517120 00000100:00100000:2.0:1790772070.881149:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428517120 00000100:00100000:2.0:1790772070.881188:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1790772070.881197:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428517120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772070.881376:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428517376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772070.881407:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772070.881439:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428517376 00000100:00100000:3.0:1790772070.881443:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428517376 00000100:00100000:3.0:1790772070.881476:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790772070.881482:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428517376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772070.881507:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772070.881542:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428517376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772070.881563:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1790772070.881583:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790772070.881609:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27401e680 x1877760428517376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772070.881625:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428517376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772070.882048:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428517248 00000100:00100000:1.0:1790772070.882053:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428517248 00000100:00100000:1.0:1790772070.882083:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790772070.882089:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428517248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772070.882147:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428517248:12345-0@lo:400:kworker.0 Request processed in 58us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772070.882153:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790772070.882245:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428517504:0@lo:400:kworker.0 00000100:00100000:3.0:1790772070.882283:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772070.882477:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428517504 00000100:00100000:1.0:1790772070.882482:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428517504 00000100:00100000:1.0:1790772070.882520:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790772070.882526:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428517504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772070.882586:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428517504:12345-0@lo:400:kworker.0 Request processed in 60us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772070.882592:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1790772070.882647:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772070.882669:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428517504:0@lo:400:kworker.0 00000100:00100000:2.0:1790772070.882736:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428517120:12345-0@lo:400:kworker.0 Request processed in 1539us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772070.882743:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1790772070.882777:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428517760:0@lo:400:kworker.0 00000100:00100000:2.0:1790772070.882804:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772070.882837:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428517248:0@lo:400:kworker.0 00000100:00100000:2.0:1790772070.882848:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772070.882853:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1877760428517632:0@lo:400:kworker.0 00000100:00100000:2.0:1790772070.882874:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772070.882991:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428517760 00000100:00100000:3.0:1790772070.882995:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428517760 00000100:00100000:3.0:1790772070.883034:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772070.883041:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428517760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772070.883077:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428517760:12345-0@lo:400:kworker.0 Request processed in 37us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772070.883083:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1790772070.883097:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790772070.883129:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64d500 x1877760428517760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772070.883139:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428517760:0@lo:400:kworker.0 00000100:00100000:1.0:1790772070.883184:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428517632 00000100:00100000:1.0:1790772070.883188:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428517632 00000100:00100000:1.0:1790772070.883222:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772070.883228:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877760428517632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772070.883262:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877760428517632:12345-0@lo:400:kworker.0 Request processed in 34us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772070.883268:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1790772070.883359:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772070.883388:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1877760428517632:0@lo:400:kworker.0 00000100:00100000:0.0:1790772070.884925:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428517120:0@lo:400:kworker.0 00000100:00100000:3.0:1790772071.392525:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428517888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772071.392641:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772071.392716:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428517888 00000100:00100000:3.0:1790772071.392723:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428517888 00000100:00100000:3.0:1790772071.392763:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772071.392772:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428517888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772071.392804:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772071.392846:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428517888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772071.392853:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1790772071.392905:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64f100 x1877760428517888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772071.392922:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428517888:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772071.455900:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772072.482771:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772072.486675:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772072.486733:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772072.486768:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412754816 00000100:00100000:3.0:1790772072.486778:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412754816 00000100:00100000:3.0:1790772072.486825:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 206 00000100:00100000:3.0:1790772072.486835:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2348:x1877760412754816:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772072.486899:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2348:x1877760412754816:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 66us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772072.486907:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 206 00000100:00100000:2.0:1790772072.487212:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412754944 00000100:00100000:2.0:1790772072.487217:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412754944 00000100:00100000:2.0:1790772072.487264:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:2.0:1790772072.487272:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412754944:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772072.487315:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412754944:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 43us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772072.487340:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00080000:3.0:1790772072.488400:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790772073.510206:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772074.527964:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772075.122956:0:10101:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:41:13 (1790772073) === 00010000:00010000:3.0:1790772075.551826:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772075.553422:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772075.553705:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412755072 00000100:00100000:1.0:1790772075.553717:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412755072 00000100:00100000:1.0:1790772075.553775:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 207 00000100:00100000:1.0:1790772075.553786:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:8123:x1877760412755072:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790772075.553801:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772075.553818:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a8ff1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226924 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772075.553844:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a8ff1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226924 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772075.553876:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a8ff1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226924 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772075.553886:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8200, rc 0) 00000100:00100000:1.0:1790772075.553956:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:8123:x1877760412755072:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 171us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772075.553963:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 207 00000100:00100000:2.0:1790772075.560669:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772075.568897:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412755200 00000100:00100000:3.0:1790772075.568911:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412755200 00000100:00100000:3.0:1790772075.568979:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 208 00000100:00100000:3.0:1790772075.568988:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:8123:x1877760412755200:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790772075.569525:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:8123:x1877760412755200:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 536us (8863us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772075.569533:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 208 00000100:00100000:2.0:1790772075.587783:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772075.588505:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412755328 00000100:00100000:3.0:1790772075.588515:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412755328 00000100:00100000:3.0:1790772075.588612:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 209 00000100:00100000:3.0:1790772075.588622:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:8123:x1877760412755328:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790772075.588843:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:8123:x1877760412755328:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 222us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772075.588857:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 209 00000100:00100000:1.0:1790772075.601334:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772075.611413:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412755456 00000100:00100000:0.0:1790772075.611428:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412755456 00000100:00100000:0.0:1790772075.611499:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 210 00000100:00100000:0.0:1790772075.611509:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:8127:x1877760412755456:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772075.611783:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:8127:x1877760412755456:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 275us (10458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772075.611792:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 210 00000100:00100000:1.0:1790772075.642664:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772075.642782:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412755584 00000100:00100000:2.0:1790772075.642792:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412755584 00000100:00100000:2.0:1790772075.642851:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 211 00000100:00100000:2.0:1790772075.642861:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:8127:x1877760412755584:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772075.643139:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:8127:x1877760412755584:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 279us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772075.643148:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 211 00000100:00100000:2.0:1790772075.651741:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772075.651834:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412755712 00000100:00100000:3.0:1790772075.651852:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412755712 00000100:00100000:3.0:1790772075.651996:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 212 00000100:00100000:3.0:1790772075.652009:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:8123:x1877760412755712:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790772075.652032:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772075.652057:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8ff23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f22694e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772075.652107:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8ff23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22694e expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772075.652119:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8ff23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22694e expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772075.652128:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3000, rc 0) 00000100:00100000:3.0:1790772075.653441:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:8123:x1877760412755712:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 203us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772075.653455:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 212 00000100:00100000:1.0:1790772075.665751:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772075.665847:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412755840 00000100:00100000:0.0:1790772075.665857:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412755840 00000100:00100000:0.0:1790772075.665915:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 213 00000100:00100000:0.0:1790772075.665925:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:8123:x1877760412755840:12345-192.168.206.27@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790772075.665967:0:5818:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790772075.665983:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790772075.665987:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790772075.665991:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790772075.665993:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1790772075.669607:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:8123:x1877760412755840:12345-192.168.206.27@tcp:256:mount.lustre.0 Request processed in 3672us (3856us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772075.669621:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 213 00000100:00100000:3.0:1790772075.687802:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772075.688472:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412755968 00000100:00100000:0.0:1790772075.688483:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412755968 00000100:00100000:0.0:1790772075.688544:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 214 00000100:00100000:0.0:1790772075.688587:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:8123:x1877760412755968:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790772075.688603:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772075.688620:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f8d9e00/0xdf68d9a7d6a8ff2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226955 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772075.688648:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f8d9e00/0xdf68d9a7d6a8ff2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226955 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772075.688659:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f8d9e00/0xdf68d9a7d6a8ff2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226955 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772075.688668:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9e00, rc 0) 00000100:00100000:0.0:1790772075.688720:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:8123:x1877760412755968:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 137us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772075.688728:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 214 00000100:00100000:1.0:1790772075.694604:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772075.697370:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412756096 00000100:00100000:0.0:1790772075.697408:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412756096 00000100:00100000:0.0:1790772075.698838:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 215 00000100:00100000:0.0:1790772075.698860:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:8123:x1877760412756096:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790772075.699165:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:8123:x1877760412756096:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 314us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772075.704595:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772075.704805:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412756224 00000100:00100000:3.0:1790772075.704815:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412756224 00000100:00100000:0.0:1790772075.714664:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 215 00000100:00100000:3.0:1790772075.715974:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 216 00000100:00100000:3.0:1790772075.715994:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:8123:x1877760412756224:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790772075.716600:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:8123:x1877760412756224:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 614us (12054us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772075.716620:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 216 00000100:00100000:2.0:1790772075.726650:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772075.726739:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412756352 00000100:00100000:0.0:1790772075.726749:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412756352 00000100:00100000:0.0:1790772075.726800:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 217 00000100:00100000:0.0:1790772075.726811:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:8133:x1877760412756352:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772075.727035:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:8133:x1877760412756352:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 225us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772075.727043:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 217 00000100:00100000:1.0:1790772075.738456:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772075.738582:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412756480 00000100:00100000:3.0:1790772075.738592:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412756480 00000100:00100000:3.0:1790772075.738634:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 218 00000100:00100000:3.0:1790772075.738642:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:8133:x1877760412756480:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790772075.738877:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:8133:x1877760412756480:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 235us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772075.738885:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 218 00000100:00100000:1.0:1790772075.757612:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772075.757660:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772075.757755:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412756608 00000100:00100000:2.0:1790772075.757765:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412756608 00000100:00100000:2.0:1790772075.757808:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412756992 00000100:00100000:2.0:1790772075.757811:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412756992 00000100:00100000:2.0:1790772075.757856:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:2.0:1790772075.757866:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412756992:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772075.757938:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412756992:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 73us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772075.757945:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:2.0:1790772075.757963:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:2.0:1790772075.757967:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2346:x1877760412756608:12345-192.168.206.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790772075.758066:0:6701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b4ee020b-4bbb-4a28-b296-bb1d54b5868f@192.168.206.27@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:2.0:1790772075.758124:0:6701:0:(genops.c:1384:class_connect()) connect: client b4ee020b-4bbb-4a28-b296-bb1d54b5868f, cookie 0xdf68d9a7d6a8ff31 00000004:00100000:2.0:1790772075.758153:0:6701:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790772075.759272:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790772075.765698:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8df248b53800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772075.765860:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:2346:x1877760412756608:12345-192.168.206.27@tcp:38:mount.lustre.0 Request processed in 7888us (8254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772075.765870:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:1.0:1790772075.781098:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772075.781673:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772075.788591:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412756864 00000100:00100000:0.0:1790772075.788605:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412756864 00000100:00100000:0.0:1790772075.788694:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412756736 00000100:00100000:0.0:1790772075.788698:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412756736 00000100:00100000:0.0:1790772075.788723:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1790772075.788733:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+7:8123:x1877760412756864:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790772075.788776:0:5823:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790772075.789269:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:2.0:1790772075.789286:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+7:0:x1877760412756736:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790772075.789302:0:5825:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790772075.789434:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+7:0:x1877760412756736:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 150us (7755us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772075.789442:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00080000:1.0:1790772075.790945:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772075.791792:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:8123:x1877760412756864:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 3054us (10697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772075.791804:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:1.0:1790772075.810446:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772075.810509:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412757120 00000100:00100000:2.0:1790772075.810523:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412757120 00000100:00100000:2.0:1790772075.810596:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:2.0:1790772075.810607:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:8123:x1877760412757120:12345-192.168.206.27@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790772075.810695:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:8123:x1877760412757120:12345-192.168.206.27@tcp:40:mount.lustre.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772075.810702:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:2.0:1790772075.814631:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772075.814671:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772075.814744:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412757248 00000100:00100000:1.0:1790772075.814753:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412757248 00000100:00100000:1.0:1790772075.814787:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412757376 00000100:00100000:1.0:1790772075.814789:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412757376 00000100:00100000:1.0:1790772075.814810:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:1.0:1790772075.814817:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1877760412757248:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790772075.814844:0:6678:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b4ee020b-4bbb-4a28-b296-bb1d54b5868f@192.168.206.27@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:1.0:1790772075.814888:0:6678:0:(genops.c:1384:class_connect()) connect: client b4ee020b-4bbb-4a28-b296-bb1d54b5868f, cookie 0xdf68d9a7d6a8ff38 00002000:00100000:1.0:1790772075.814898:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b4ee020b-4bbb-4a28-b296-bb1d54b5868f/ffff8df273ebd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790772075.814917:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790772075.815113:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1790772075.815220:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:2.0:1790772075.815225:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1877760412757376:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790772075.815241:0:6679:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b4ee020b-4bbb-4a28-b296-bb1d54b5868f@192.168.206.27@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:2.0:1790772075.815274:0:6679:0:(genops.c:1384:class_connect()) connect: client b4ee020b-4bbb-4a28-b296-bb1d54b5868f, cookie 0xdf68d9a7d6a8ff3f 00002000:00100000:2.0:1790772075.815279:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b4ee020b-4bbb-4a28-b296-bb1d54b5868f/ffff8df248b51800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790772075.815292:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790772075.815579:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790772075.815599:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8df248b56000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772075.815654:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:2346:x1877760412757376:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 427us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772075.815662:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00080000:1.0:1790772075.815724:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8df273eb8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772075.815748:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:2346:x1877760412757248:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 930us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772075.815754:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:1.0:1790772075.823650:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772075.825225:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412757504 00000100:00100000:3.0:1790772075.825238:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412757504 00000100:00100000:3.0:1790772075.825363:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:3.0:1790772075.825374:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:8123:x1877760412757504:12345-192.168.206.27@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790772075.825449:0:5826:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790772075.825690:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:8123:x1877760412757504:12345-192.168.206.27@tcp:33:mount.lustre.0 Request processed in 317us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772075.825699:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:3.0:1790772075.999868:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428518144:0@lo:400:kworker.0 00000100:00100000:2.0:1790772075.999965:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428518272:0@lo:400:kworker.0 00000100:00100000:3.0:1790772075.999970:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772076.000049:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428518656:0@lo:400:kworker.0 00000100:00100000:0.0:1790772076.000123:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428518016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772076.000202:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428518400:0@lo:400:kworker.0 00000100:00100000:3.0:1790772076.002767:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772076.002888:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428518144 00000100:00100000:3.0:1790772076.002899:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428518144 00000100:00100000:3.0:1790772076.002971:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790772076.002982:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428518144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772076.003067:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428518144:12345-0@lo:400:kworker.0 Request processed in 86us (3099us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772076.003089:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790772076.003143:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428518144:0@lo:400:kworker.0 00000100:00100000:3.0:1790772076.003185:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428518656 00000100:00100000:3.0:1790772076.003189:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428518656 00000100:00100000:3.0:1790772076.003237:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790772076.003243:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428518656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772076.003282:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428518656:12345-0@lo:400:kworker.0 Request processed in 39us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772076.003288:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790772076.003313:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428518656:0@lo:400:kworker.0 00000100:00080000:3.0:1790772076.003346:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772076.006811:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772076.006874:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428518528:0@lo:400:kworker.0 00000100:00100000:1.0:1790772076.007260:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772076.007488:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428518400 00000100:00100000:2.0:1790772076.007499:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428518400 00000100:00080000:1.0:1790772076.007580:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772076.007622:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790772076.007635:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428518400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772076.007708:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428518400:12345-0@lo:400:kworker.0 Request processed in 76us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772076.007715:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790772076.007750:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772076.007771:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428518784:0@lo:400:kworker.0 00000100:00100000:0.0:1790772076.008452:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772076.008723:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428518400:0@lo:400:kworker.0 00000100:00100000:3.0:1790772076.008777:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428518016 00000100:00100000:3.0:1790772076.008787:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428518016 00000100:00100000:1.0:1790772076.008794:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428518272 00000100:00100000:1.0:1790772076.008801:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428518272 00000100:00100000:3.0:1790772076.008856:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790772076.008867:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428518016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772076.008897:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772076.008925:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790772076.008972:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428518016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772076.008980:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790772076.009003:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428518272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772076.009178:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428518528 00000100:00100000:1.0:1790772076.009252:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428518272:12345-0@lo:400:kworker.0 Request processed in 318us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772076.009261:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790772076.009510:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428518528 00000100:00100000:2.0:1790772076.009607:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790772076.009617:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428518528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772076.009667:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772076.009750:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428518784 00000100:00100000:3.0:1790772076.009753:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428518272:0@lo:400:kworker.0 00000100:00100000:0.0:1790772076.009758:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428518784 00000100:00080000:3.0:1790772076.009812:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772076.009820:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1790772076.009822:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772076.009831:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428518784:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790772076.009954:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27401d500 x1877760428518016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772076.009977:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428518016:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790772076.009988:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f8d4e00 x1877760428518528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772076.010210:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428518528:0@lo:400:kworker.0 00000100:00100000:2.0:1790772076.010654:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428518528:12345-0@lo:400:kworker.0 Request processed in 1037us (3747us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772076.010663:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790772076.010986:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428518784:12345-0@lo:400:kworker.0 Request processed in 1157us (1322us total) trans 0 rc 0/0 00010000:00080000:3.0:1790772076.011126:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f552d80 x1877760428518784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772076.011138:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428518784:0@lo:400:kworker.0 00000100:00100000:0.0:1790772076.011180:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790772076.514451:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772076.514480:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428518912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772076.514541:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772076.516942:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428518912 00000100:00100000:3.0:1790772076.516963:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428518912 00000100:00100000:3.0:1790772076.517065:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790772076.517089:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428518912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772076.517122:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772076.517228:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428518912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772076.517236:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1790772076.517302:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64c000 x1877760428518912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772076.517324:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428518912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772076.578213:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790772076.585482:0:5845:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b4ee020b-4bbb-4a28-b296-bb1d54b5868f 00000001:00100000:2.0:1790772077.075605:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b4ee020b-4bbb-4a28-b296-bb1d54b5868f 00010000:00010000:3.0:1790772077.601095:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772078.628111:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772079.648472:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790772080.665670:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b4ee020b-4bbb-4a28-b296-bb1d54b5868f 00010000:00010000:0.0:1790772080.671683:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790772081.036943:0:10299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1790772081.119985:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428519040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772081.120099:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772081.120702:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428519168:0@lo:400:kworker.0 00000100:00100000:2.0:1790772081.120753:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772081.120839:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428519040 00000100:00100000:1.0:1790772081.120849:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428519040 00000100:00100000:1.0:1790772081.120918:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790772081.120928:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428519040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772081.120972:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772081.121041:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428519040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772081.121059:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1790772081.121085:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772081.121755:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428519296:0@lo:400:kworker.0 00000100:00100000:3.0:1790772081.121805:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772081.121869:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428519168 00000100:00100000:3.0:1790772081.121875:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428519168 00000100:00100000:3.0:1790772081.121914:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1790772081.121923:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428519168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772081.123933:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428519424:0@lo:400:kworker.0 00000100:00100000:0.0:1790772081.124008:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772081.124062:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772081.124069:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428519552:0@lo:400:kworker.0 00000100:00100000:0.0:1790772081.124094:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772081.124120:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772081.124128:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428519680:0@lo:400:kworker.0 00000100:00100000:0.0:1790772081.124157:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772081.124197:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428519296 00000100:00100000:0.0:1790772081.124206:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428519296 00000100:00100000:0.0:1790772081.124254:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428519424 00000100:00100000:0.0:1790772081.124258:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428519424 00000100:00100000:0.0:1790772081.124279:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428519552 00000100:00100000:0.0:1790772081.124281:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428519552 00000100:00100000:0.0:1790772081.124296:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790772081.124304:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428519296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772081.124381:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428519296:12345-0@lo:400:kworker.0 Request processed in 77us (2575us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772081.124389:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790772081.124407:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790772081.124413:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428519424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772081.124449:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428519424:12345-0@lo:400:kworker.0 Request processed in 36us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772081.124455:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790772081.124466:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790772081.124471:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428519552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772081.124497:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428519552:12345-0@lo:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772081.124503:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1790772081.124527:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772081.124882:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428519680 00000100:00100000:1.0:1790772081.124889:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428519680 00000100:00100000:1.0:1790772081.124931:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790772081.124939:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428519680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772081.124981:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428519680:12345-0@lo:400:kworker.0 Request processed in 43us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772081.124987:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790772081.125000:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428519296:0@lo:400:kworker.0 00010000:00080000:0.0:1790772081.125036:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25e305f80 x1877760428519680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772081.125057:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428519680:0@lo:400:kworker.0 00000100:00080000:0.0:1790772081.125075:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772081.125093:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428519552:0@lo:400:kworker.0 00000100:00100000:0.0:1790772081.125102:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428519424:0@lo:400:kworker.0 00010000:00080000:0.0:1790772081.125134:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64c700 x1877760428519040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772081.125168:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428519040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772081.125297:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428519168:12345-0@lo:400:kworker.0 Request processed in 3372us (4540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772081.125326:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790772081.127899:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428519168:0@lo:400:kworker.0 00000100:00100000:1.0:1790772081.200542:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772081.200619:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772081.200654:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772081.200696:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772081.200727:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772081.200759:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412758144 00000100:00100000:1.0:1790772081.200772:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412758144 00000100:00100000:1.0:1790772081.200854:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412758016 00000100:00100000:1.0:1790772081.200858:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412758016 00000100:00100000:1.0:1790772081.200883:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:1.0:1790772081.200892:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412758144:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772081.200985:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412758144:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 93us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772081.200994:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:1.0:1790772081.201013:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:1.0:1790772081.201019:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412758016:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772081.201059:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412758016:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772081.201066:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:3.0:1790772081.201491:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412757888 00000100:00100000:3.0:1790772081.201498:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412757888 00000100:00100000:3.0:1790772081.201575:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412757760 00000100:00100000:3.0:1790772081.201579:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412757760 00000100:00100000:3.0:1790772081.201607:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:3.0:1790772081.201615:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412757888:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772081.201672:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412757888:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 57us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772081.201680:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:3.0:1790772081.201695:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:3.0:1790772081.201701:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2349:x1877760412757760:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772081.201727:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2349:x1877760412757760:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 26us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772081.201733:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:0.0:1790772081.201975:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412757632 00000100:00100000:0.0:1790772081.201981:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412757632 00000100:00100000:0.0:1790772081.202021:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 221 00000100:00100000:0.0:1790772081.202031:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2349:x1877760412757632:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772081.202095:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2349:x1877760412757632:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 66us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772081.202103:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 221 00000100:00080000:0.0:1790772081.202152:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772081.202158:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772081.202161:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772081.633135:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772081.633162:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428519808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772081.633238:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772081.633329:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428519808 00000100:00100000:0.0:1790772081.633342:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428519808 00000100:00100000:0.0:1790772081.633414:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790772081.633425:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428519808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772081.633470:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772081.633586:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428519808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772081.633595:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1790772081.633700:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64c000 x1877760428519808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772081.633733:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428519808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772081.695776:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772082.719674:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772083.743782:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772084.772523:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772085.792216:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772086.239851:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428520320:0@lo:400:kworker.0 00000100:00100000:0.0:1790772086.239913:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772086.239974:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772086.239980:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428520192:0@lo:400:kworker.0 00000100:00100000:0.0:1790772086.240043:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772086.240083:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428520320 00000100:00100000:0.0:1790772086.240090:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428520320 00000100:00100000:0.0:1790772086.240147:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790772086.240157:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428520320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772086.240222:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428520320:12345-0@lo:400:kworker.0 Request processed in 66us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772086.240229:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1790772086.240251:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790772086.240290:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df273fe0000 x1877760428520320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772086.240304:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428520320:0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.240577:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428520064:0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.240606:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772086.240622:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428520576:0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.240640:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772086.240662:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790772086.240667:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428519936:0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.240690:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772086.240720:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428520448:0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.240751:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772086.240781:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428520192 00000100:00100000:3.0:1790772086.240785:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428520192 00000100:00100000:3.0:1790772086.240815:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428520064 00000100:00100000:3.0:1790772086.240818:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428520064 00000100:00100000:3.0:1790772086.240841:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428520448 00000100:00100000:3.0:1790772086.240844:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428520448 00000100:00100000:3.0:1790772086.240856:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790772086.240863:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24319a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428520192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.240900:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24319a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428520192:12345-0@lo:400:kworker.0 Request processed in 38us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772086.240906:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790772086.240917:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790772086.240922:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428520064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.240948:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428520064:12345-0@lo:400:kworker.0 Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772086.240953:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790772086.240962:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772086.240967:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428520448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.240987:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428520448:12345-0@lo:400:kworker.0 Request processed in 20us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772086.240992:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772086.241005:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428520576 00000100:00100000:3.0:1790772086.241007:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428520576 00000100:00100000:3.0:1790772086.241044:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790772086.241051:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428520576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.241088:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428520576:12345-0@lo:400:kworker.0 Request processed in 38us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772086.241094:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790772086.241111:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428519936 00000100:00100000:3.0:1790772086.241114:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428519936 00000100:00100000:3.0:1790772086.241136:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1790772086.241141:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428519936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.241167:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428519936:12345-0@lo:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772086.241172:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:3.0:1790772086.241199:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772086.241202:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772086.241218:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428519936:0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.241229:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428520448:0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.241237:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428520064:0@lo:400:kworker.0 00010000:00080000:3.0:1790772086.241246:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df273fe0a80 x1877760428520576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772086.241255:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428520576:0@lo:400:kworker.0 00000100:00100000:3.0:1790772086.241284:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428520192:0@lo:400:kworker.0 00000100:00100000:2.0:1790772086.248406:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428520704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772086.248472:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772086.248651:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428520704 00000100:00100000:1.0:1790772086.248658:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428520704 00000100:00100000:1.0:1790772086.248720:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790772086.248730:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428520704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772086.248762:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772086.248815:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428520704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772086.248822:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1790772086.248995:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64c000 x1877760428520704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772086.249012:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428520704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772086.318689:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772086.318735:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772086.318970:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772086.319003:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772086.319040:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772086.319079:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412758784 00000100:00100000:0.0:1790772086.319091:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412758784 00000100:00100000:0.0:1790772086.319165:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412758656 00000100:00100000:0.0:1790772086.319169:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412758656 00000100:00100000:0.0:1790772086.319194:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:0.0:1790772086.319205:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412758784:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772086.319620:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:2.0:1790772086.319646:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412758656:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772086.319692:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412758656:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 42us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772086.319701:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:0.0:1790772086.319952:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412758784:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 747us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772086.319959:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:3.0:1790772086.320061:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412758272 00000100:00100000:3.0:1790772086.320068:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412758272 00000100:00100000:3.0:1790772086.320125:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 223 00000100:00100000:3.0:1790772086.320134:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412758272:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772086.320168:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412758272:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 35us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772086.320190:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 223 00000100:00100000:1.0:1790772086.320834:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412758528 00000100:00100000:1.0:1790772086.320850:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412758528 00000100:00100000:1.0:1790772086.320898:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412758400 00000100:00100000:1.0:1790772086.320901:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412758400 00000100:00100000:1.0:1790772086.320932:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:1.0:1790772086.320941:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24319aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412758528:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772086.320986:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24319aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412758528:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 47us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772086.320993:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:1.0:1790772086.321007:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:1.0:1790772086.321013:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24319b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2350:x1877760412758400:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772086.321048:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24319b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2350:x1877760412758400:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 35us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772086.321055:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00080000:1.0:1790772086.321114:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772086.321119:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772086.321123:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772086.763729:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772086.763762:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428520832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772086.763859:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772086.763959:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428520832 00000100:00100000:1.0:1790772086.763969:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428520832 00000100:00100000:1.0:1790772086.764042:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790772086.764055:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428520832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772086.764103:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772086.764169:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428520832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772086.764177:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1790772086.764253:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64c000 x1877760428520832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772086.764282:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428520832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772086.817639:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772087.839739:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772088.863743:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772089.888139:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772090.911812:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772091.360578:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772091.360599:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428520960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772091.360666:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772091.360716:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428520960 00000100:00100000:3.0:1790772091.360724:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428520960 00000100:00080000:1.0:1790772091.360756:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772091.360782:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790772091.360793:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428520960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772091.360825:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772091.360873:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428520960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772091.361288:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428521216:0@lo:400:kworker.0 00000100:00100000:2.0:1790772091.361333:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772091.361373:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772091.361393:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428521344:0@lo:400:kworker.0 00000100:00100000:2.0:1790772091.361418:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772091.361452:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428521216 00000100:00100000:2.0:1790772091.361456:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428521216 00000100:00100000:2.0:1790772091.361486:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428521344 00000100:00100000:2.0:1790772091.361488:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428521344 00000100:00100000:2.0:1790772091.361510:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790772091.361516:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428521216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772091.361578:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428521216:12345-0@lo:400:kworker.0 Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772091.361584:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790772091.361599:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790772091.361604:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428521344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772091.361627:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428521344:12345-0@lo:400:kworker.0 Request processed in 24us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772091.361632:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790772091.361652:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428521472:0@lo:400:kworker.0 00000100:00100000:2.0:1790772091.361676:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772091.361694:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790772091.361699:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428521088:0@lo:400:kworker.0 00000100:00100000:2.0:1790772091.361725:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772091.361751:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428521600:0@lo:400:kworker.0 00000100:00100000:2.0:1790772091.361788:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772091.361866:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428521472 00000100:00100000:0.0:1790772091.361871:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428521472 00000100:00100000:2.0:1790772091.361925:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428521088 00000100:00100000:2.0:1790772091.361929:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428521088 00010000:00080000:1.0:1790772091.362489:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64c000 x1877760428520960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772091.362509:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428520960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772091.362741:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790772091.364964:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790772091.364983:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428521472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772091.365090:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428521472:12345-0@lo:400:kworker.0 Request processed in 115us (3413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772091.365098:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790772091.365226:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428521472:0@lo:400:kworker.0 00000100:00080000:0.0:1790772091.365269:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772091.365358:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428521344:0@lo:400:kworker.0 00000100:00100000:0.0:1790772091.365379:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428521216:0@lo:400:kworker.0 00000100:00100000:2.0:1790772091.365477:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790772091.365488:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428521088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772091.365622:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428521088:12345-0@lo:400:kworker.0 Request processed in 136us (3895us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772091.365628:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790772091.365662:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428521600 00000100:00100000:2.0:1790772091.365668:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428521600 00000100:00100000:2.0:1790772091.365759:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790772091.365767:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428521600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772091.365800:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428521600:12345-0@lo:400:kworker.0 Request processed in 35us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772091.365806:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1790772091.365948:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772091.367019:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428521088:0@lo:400:kworker.0 00010000:00080000:3.0:1790772091.367038:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f552a00 x1877760428521600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772091.367049:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428521600:0@lo:400:kworker.0 00000100:00100000:0.0:1790772091.431677:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772091.431715:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772091.431751:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772091.431772:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772091.431809:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772091.431838:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412759424 00000100:00100000:0.0:1790772091.431847:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412759424 00000100:00100000:0.0:1790772091.431908:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412759296 00000100:00100000:0.0:1790772091.431912:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412759296 00000100:00100000:2.0:1790772091.432114:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412758912 00000100:00100000:2.0:1790772091.432120:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412758912 00000100:00100000:2.0:1790772091.432155:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 225 00000100:00100000:2.0:1790772091.432169:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2347:x1877760412758912:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772091.432183:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412759168 00000100:00100000:3.0:1790772091.432197:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412759168 00000100:00100000:2.0:1790772091.432244:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2347:x1877760412758912:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 78us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772091.432253:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 225 00000100:00100000:3.0:1790772091.432263:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412759040 00000100:00100000:3.0:1790772091.432269:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412759040 00000100:00100000:2.0:1790772091.432315:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:3.0:1790772091.432326:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:2.0:1790772091.432330:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412759424:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772091.432344:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24319a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412759168:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772091.432371:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412759424:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 45us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772091.432379:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:2.0:1790772091.432413:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:3.0:1790772091.432423:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24319a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412759168:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 83us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772091.432428:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27414d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412759296:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772091.432472:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:3.0:1790772091.432497:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:2.0:1790772091.432506:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27414d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412759296:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 82us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772091.432509:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412759040:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772091.432533:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:3.0:1790772091.432598:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412759040:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 92us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772091.432609:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00080000:0.0:1790772091.433111:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772091.433118:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772091.433120:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772091.881815:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772091.881842:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428521728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772091.881922:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772091.882020:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428521728 00000100:00100000:2.0:1790772091.882028:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428521728 00000100:00100000:2.0:1790772091.882079:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790772091.882198:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428521728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772091.882245:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772091.882298:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428521728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772091.882306:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1790772091.882354:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f552300 x1877760428521728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772091.882377:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428521728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772091.936845:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772092.968317:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772093.983733:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772095.009252:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772096.035189:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772096.479846:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428521856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772096.479912:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772096.480257:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428522112:0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.480294:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772096.480317:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790772096.480323:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428521984:0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.480351:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772096.480375:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428522496:0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.480411:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772096.480454:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428522112 00000100:00100000:1.0:1790772096.480461:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428522112 00000100:00100000:1.0:1790772096.480812:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790772096.480823:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428522112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.480883:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428522112:12345-0@lo:400:kworker.0 Request processed in 56us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772096.480904:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790772096.480928:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428521984 00000100:00100000:1.0:1790772096.480932:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428521984 00000100:00100000:1.0:1790772096.480957:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1790772096.480963:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428521984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.481006:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428521984:12345-0@lo:400:kworker.0 Request processed in 42us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772096.481011:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1790772096.481036:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428522496 00000100:00100000:1.0:1790772096.481039:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428522496 00000100:00100000:1.0:1790772096.481079:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790772096.481085:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428522496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.481112:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428522496:12345-0@lo:400:kworker.0 Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772096.481117:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790772096.481150:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1877760428522368:0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.481355:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772096.481378:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772096.481395:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428522240:0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.481427:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772096.481450:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428522368 00000100:00100000:1.0:1790772096.481453:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428522368 00000100:00100000:1.0:1790772096.481472:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428522240 00000100:00100000:1.0:1790772096.481474:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428522240 00000100:00100000:1.0:1790772096.481485:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790772096.481659:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877760428522368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.481708:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877760428522368:12345-0@lo:400:kworker.0 Request processed in 216us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772096.481714:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790772096.481727:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790772096.481733:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428522240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.481757:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428522240:12345-0@lo:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772096.481762:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790772096.481803:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428521984:0@lo:400:kworker.0 00010000:00080000:1.0:1790772096.481815:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64c700 x1877760428522496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772096.481826:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428522496:0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.481836:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428522112:0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.481869:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428522240:0@lo:400:kworker.0 00000100:00100000:1.0:1790772096.481876:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1877760428522368:0@lo:400:kworker.0 00000100:00100000:3.0:1790772096.482358:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428521856 00000100:00100000:3.0:1790772096.482364:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428521856 00000100:00100000:3.0:1790772096.482593:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790772096.482602:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428521856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772096.482630:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772096.482677:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428521856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772096.482684:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1790772096.482861:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772096.482866:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772096.482868:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790772096.482937:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747d4380 x1877760428521856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772096.482954:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2747d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428521856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772096.551950:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772096.552036:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412759552 00000100:00100000:2.0:1790772096.552051:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412759552 00000100:00100000:2.0:1790772096.552118:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 227 00000100:00100000:2.0:1790772096.552128:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412759552:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772096.552714:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412759552:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 586us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772096.552722:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 227 00000100:00100000:0.0:1790772096.560188:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772096.560231:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772096.560266:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772096.560303:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772096.560334:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412759936 00000100:00100000:0.0:1790772096.560357:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412759936 00000100:00100000:0.0:1790772096.560422:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412760064 00000100:00100000:0.0:1790772096.560426:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412760064 00000100:00100000:0.0:1790772096.560451:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1790772096.560460:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2346:x1877760412759936:12345-192.168.206.27@tcp:9:kworker.0 00000100:00100000:2.0:1790772096.560493:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412759808 00000020:00000080:0.0:1790772096.560502:0:8509:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8ff38 00000100:00100000:2.0:1790772096.560508:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412759808 00000100:00080000:0.0:1790772096.560514:0:8509:0:(import.c:65:import_set_state_nolock()) ffff8df273eb8800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790772096.560602:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412759680 00000100:00100000:2.0:1790772096.560608:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412759680 00000100:00100000:2.0:1790772096.560641:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:2.0:1790772096.560651:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24319bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412759808:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772096.560751:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24319bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412759808:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 101us (571us total) trans 0 rc 0/0 00000001:00000004:0.0:1790772096.560756:0:8509:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790772096.560763:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:2.0:1790772096.560790:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:2.0:1790772096.560799:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412759680:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772096.560849:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412759680:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 51us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772096.560855:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:0.0:1790772096.561115:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+2:2346:x1877760412759936:12345-192.168.206.27@tcp:9:kworker.0 Request processed in 653us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772096.561124:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1790772096.561144:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1790772096.561152:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24319ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2346:x1877760412760064:12345-192.168.206.27@tcp:9:kworker.0 00000020:00000080:0.0:1790772096.561287:0:8509:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8ff3f 00000100:00080000:0.0:1790772096.561294:0:8509:0:(import.c:65:import_set_state_nolock()) ffff8df248b56000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790772096.561322:0:8509:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1790772096.561601:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772096.561658:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24319ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+2:2346:x1877760412760064:12345-192.168.206.27@tcp:9:kworker.0 Request processed in 505us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772096.561667:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00080000:0.0:1790772096.561689:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772096.561694:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772096.561696:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790772096.561707:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772096.993253:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772096.993273:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428522624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772096.993331:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772096.993383:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428522624 00000100:00100000:0.0:1790772096.993403:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428522624 00000100:00100000:0.0:1790772096.993441:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790772096.993448:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428522624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772096.993478:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772096.993516:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428522624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772096.993522:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1790772096.993579:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df243199880 x1877760428522624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772096.993595:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428522624:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772097.055764:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772097.556357:0:10999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1790772097.566012:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b4ee020b-4bbb-4a28-b296-bb1d54b5868f 00000020:00000080:1.0:1790772097.566020:0:6704:0:(genops.c:885:class_export_put()) final put ffff8df273ebd000/b4ee020b-4bbb-4a28-b296-bb1d54b5868f 00000020:00000080:0.0:1790772097.566077:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df273ebd000/b4ee020b-4bbb-4a28-b296-bb1d54b5868f for lustre-OST0000 00000020:00000080:0.0:1790772097.566126:0:2348:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df273eb8800 for lustre-OST0000 00010000:00010000:0.0:1790772098.080341:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772099.103886:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772100.127724:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772101.152809:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790772101.202198:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b4ee020b-4bbb-4a28-b296-bb1d54b5868f 00000020:00000080:0.0:1790772101.202205:0:7629:0:(genops.c:885:class_export_put()) final put ffff8df248b51800/b4ee020b-4bbb-4a28-b296-bb1d54b5868f 00000020:00000080:0.0:1790772101.202241:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df248b51800/b4ee020b-4bbb-4a28-b296-bb1d54b5868f for lustre-OST0001 00000020:00000080:0.0:1790772101.202282:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df248b56000 for lustre-OST0001 00000020:00000080:0.0:1790772101.522060:0:11149:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde48b2080 20000000:00000080:0.0:1790772101.522076:0:11149:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df2747bc400 uarg=0000000000000000 20000000:01000000:0.0:1790772101.522179:0:11149:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790772101.522184:0:11149:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790772101.522188:0:11149:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790772101.522939:0:11150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1790772101.523159:0:11149:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790772101.529968:0:11149:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790772101.530010:0:11149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530029:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8feeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22691d expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530038:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fef9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fef2 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530045:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f8d8800/0xdf68d9a7d6a8ff07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff00 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530051:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff0e expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530057:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f8d9e00/0xdf68d9a7d6a8ff2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226955 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530064:0:11149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530166:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f8d9e00/0xdf68d9a7d6a8ff2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226955 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530182:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df26f8d9e00/0xdf68d9a7d6a8ff2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226955 expref: 12 pid: 5816 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772101.530196:0:11149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243199880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1877760428522752:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772101.530349:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff0e expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530367:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff0e expref: 18 pid: 5817 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772101.530377:0:11149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df24319b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1877760428522880:0@lo:104: 00000100:00100000:0.0:1790772101.530415:0:11149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790772101.530452:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f8d8800/0xdf68d9a7d6a8ff07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff00 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530460:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df26f8d8800/0xdf68d9a7d6a8ff07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff00 expref: 18 pid: 5818 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772101.530468:0:11149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df24319b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1877760428523008:0@lo:104: 00000100:00100000:0.0:1790772101.530487:0:11149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790772101.530509:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8fef2 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530522:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fef9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fef2 expref: 18 pid: 5816 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772101.530530:0:11149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243198000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1877760428523136:0@lo:104: 00000100:00100000:0.0:1790772101.530579:0:11149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790772101.530602:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8feeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22691d expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.530610:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8feeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22691d expref: 12 pid: 5816 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772101.530617:0:11149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243198700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1877760428523264:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772101.530649:0:11149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f78300 going to sleep for 11 seconds 00000100:00100000:1.0:1790772101.530735:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428522880 00000100:00100000:1.0:1790772101.530748:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428522880 00000100:00100000:1.0:1790772101.530779:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428523008 00000100:00100000:1.0:1790772101.530781:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428523008 00000100:00100000:1.0:1790772101.530789:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428523136 00000100:00100000:1.0:1790772101.530791:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428523136 00000100:00100000:1.0:1790772101.530811:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772101.530820:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:11149:x1877760428522880:12345-0@lo:104: 00010000:00010000:1.0:1790772101.530831:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.530878:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772101.530883:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+5:11149:x1877760428522880:12345-0@lo:104: Request processed in 65us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772101.530889:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772101.530904:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790772101.530909:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:11149:x1877760428523008:12345-0@lo:104: 00010000:00010000:1.0:1790772101.530916:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.530952:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790772101.530958:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:11149:x1877760428523008:12345-0@lo:104: Request processed in 49us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772101.530963:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790772101.530974:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772101.530979:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:11149:x1877760428523136:12345-0@lo:104: 00010000:00010000:1.0:1790772101.530986:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.531011:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790772101.531021:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:11149:x1877760428523136:12345-0@lo:104: Request processed in 43us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772101.531027:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790772101.531260:0:11149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df24319b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1877760428522880:0@lo:104: 00000100:00100000:0.0:1790772101.531267:0:11149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df24319b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1877760428523008:0@lo:104: 00000100:00100000:0.0:1790772101.531274:0:11149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243198000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1877760428523136:0@lo:104: 00010000:00010000:1.0:1790772101.531487:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790772101.531493:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.531506:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772101.531511:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.531519:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772101.531527:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772101.531533:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790772101.531583:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.531590:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772101.531609:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.531615:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9a00/0xdf68d9a7d6a8ff0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff15 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.531627:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772101.531630:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.532907:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9800 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772101.532912:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.532920:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772101.532926:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772101.532930:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790772101.532969:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.532974:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772101.532984:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.532989:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff07 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.532999:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772101.533002:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.533007:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390800 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772101.533009:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.533025:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772101.533030:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772101.533035:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790772101.533046:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.533050:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772101.533066:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.533072:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df241390800/0xdf68d9a7d6a8fef2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8fef9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.533997:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772101.534001:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772101.534004:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772101.534010:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772101.534038:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428523392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772101.534170:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772101.534216:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772101.534223:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428523520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772101.534247:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772101.534277:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428523648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772101.534300:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772101.534345:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428523392 00000100:00100000:1.0:1790772101.534353:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428523392 00010000:00010000:1.0:1790772101.534381:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff0e expref: 19 pid: 5817 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772101.534407:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428523520 00000100:00100000:1.0:1790772101.534410:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428523520 00010000:00010000:1.0:1790772101.534423:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f8d8800/0xdf68d9a7d6a8ff07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff00 expref: 20 pid: 5818 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772101.534434:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428523648 00000100:00100000:1.0:1790772101.534437:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428523648 00010000:00010000:1.0:1790772101.534447:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fef9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fef2 expref: 21 pid: 5816 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772101.534460:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790772101.534468:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246095450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+21:3293:x1877760428523392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772101.534480:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772101.534485:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff0e expref: 21 pid: 5817 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.534495:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff0e expref: 21 pid: 5817 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.534510:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff0e expref: 21 pid: 5817 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.534524:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772101.534579:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246095450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+20:3293:x1877760428523392:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772101.534586:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790772101.534632:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790772101.534638:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428523520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772101.534646:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772101.534650:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f8d8800/0xdf68d9a7d6a8ff07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff00 expref: 19 pid: 5818 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.534658:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f8d8800/0xdf68d9a7d6a8ff07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff00 expref: 19 pid: 5818 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.534668:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f8d8800/0xdf68d9a7d6a8ff07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff00 expref: 19 pid: 5818 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.534678:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772101.534701:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:3293:x1877760428523520:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772101.534706:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790772101.534718:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772101.534724:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:3295:x1877760428523648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772101.534732:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772101.534736:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fef9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fef2 expref: 17 pid: 5816 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.534744:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fef2 expref: 17 pid: 5816 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.534754:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a8fef9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8fef2 expref: 17 pid: 5816 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.534763:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772101.534797:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3295:x1877760428523648:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772101.534815:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772101.534854:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428523648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772101.534879:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428523520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772101.534886:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428523392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772101.536736:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772101.536820:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772101.536832:0:11149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243199880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1877760428522752:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772101.536839:0:11149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243198700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1877760428523264:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772101.536859:0:11149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772101.536986:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412760192 00000100:00100000:2.0:1790772101.536991:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412760320 00000100:00100000:1.0:1790772101.536993:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412760192 00000100:00100000:2.0:1790772101.537009:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412760320 00010000:00010000:1.0:1790772101.537023:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f8d9e00/0xdf68d9a7d6a8ff2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226955 expref: 14 pid: 5816 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.537031:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8feeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22691d expref: 14 pid: 5816 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772101.537179:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:1.0:1790772101.537195:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c23a58-79a4-4ff1-a93b-1cfd03211375+14:2347:x1877760412760192:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772101.537210:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772101.537216:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f8d9e00/0xdf68d9a7d6a8ff2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226955 expref: 14 pid: 5816 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772101.537235:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00010000:00010000:1.0:1790772101.537247:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f8d9e00/0xdf68d9a7d6a8ff2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226955 expref: 14 pid: 5816 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772101.537248:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c23a58-79a4-4ff1-a93b-1cfd03211375+14:2347:x1877760412760320:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772101.537273:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f8d9e00/0xdf68d9a7d6a8ff2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226955 expref: 14 pid: 5816 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.537275:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772101.537284:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8feeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22691d expref: 14 pid: 5816 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.537294:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8feeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22691d expref: 13 pid: 5816 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772101.537396:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772101.537429:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a2400/0xdf68d9a7d6a8feeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22691d expref: 13 pid: 5816 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.537443:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.537453:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772101.537454:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:2347:x1877760412760192:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 264us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772101.537470:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 28 00010000:00010000:2.0:1790772101.537476:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.537484:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.537491:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.537510:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.537515:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772101.537520:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.537527:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.537645:0:11149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772101.537653:0:11149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.538354:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.538366:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f8d9000/0xdf68d9a7d6a8ff46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772101.538382:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772101.538431:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:2347:x1877760412760320:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 1184us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772101.538438:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:0.0:1790772101.601594:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428523776:0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.601664:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772101.601711:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428524288:0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.601733:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772101.601762:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772101.601768:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428524160:0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.601788:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772101.601812:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428524032:0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.601834:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772101.601853:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772101.601858:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428523904:0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.601898:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772101.601932:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428523776 00000100:00100000:0.0:1790772101.601939:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428523776 00000100:00100000:0.0:1790772101.602437:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428524160 00000100:00100000:0.0:1790772101.602442:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428524160 00000100:00100000:0.0:1790772101.602471:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428523904 00000100:00100000:0.0:1790772101.602474:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428523904 00000100:00100000:0.0:1790772101.602490:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790772101.602498:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428523776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.602577:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428523776:12345-0@lo:400:kworker.0 Request processed in 79us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772101.602584:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790772101.602599:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790772101.602605:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428524160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.602628:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428524160:12345-0@lo:400:kworker.0 Request processed in 24us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772101.602633:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790772101.602640:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790772101.602645:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428523904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.602667:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428523904:12345-0@lo:400:kworker.0 Request processed in 23us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772101.602673:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790772101.602688:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428524288 00000100:00100000:0.0:1790772101.602691:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428524288 00000100:00100000:0.0:1790772101.602710:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428524032 00000100:00100000:0.0:1790772101.602712:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428524032 00000100:00100000:0.0:1790772101.602727:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790772101.602731:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428524288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.602755:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428524288:12345-0@lo:400:kworker.0 Request processed in 23us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772101.602769:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790772101.602778:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790772101.602782:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428524032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.602803:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428524032:12345-0@lo:400:kworker.0 Request processed in 21us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772101.602807:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1790772101.602830:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790772101.602833:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772101.602836:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772101.602862:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428524160:0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.602873:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428523776:0@lo:400:kworker.0 00010000:00080000:0.0:1790772101.602884:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df273fe1f80 x1877760428524288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772101.602894:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428524288:0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.602923:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428523904:0@lo:400:kworker.0 00010000:00080000:0.0:1790772101.602931:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df273fe3480 x1877760428524032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772101.602939:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428524032:0@lo:400:kworker.0 00000100:00100000:0.0:1790772101.603567:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790772101.603579:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428524416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772101.603615:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772101.604066:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428524416 00000100:00100000:2.0:1790772101.604073:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428524416 00000100:00100000:2.0:1790772101.604119:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790772101.604127:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428524416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772101.604158:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772101.604198:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428524416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772101.604204:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1790772101.604776:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f64aa00 x1877760428524416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772101.604809:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428524416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772101.674493:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772101.674643:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772101.678093:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412760448 00000100:00100000:2.0:1790772101.678107:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412760448 00000100:00100000:1.0:1790772101.678228:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412760576 00000100:00100000:1.0:1790772101.678232:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412760576 00000100:00080000:0.0:1790772101.678278:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772101.678364:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:2.0:1790772101.678375:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2349:x1877760412760448:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772101.678473:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2349:x1877760412760448:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 100us (3988us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772101.678481:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:0.0:1790772101.679012:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:0.0:1790772101.679033:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412760576:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772101.679134:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412760576:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 103us (4490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772101.679141:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:2.0:1790772102.111773:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428524544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772102.111845:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772102.112319:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428524544 00000100:00100000:0.0:1790772102.112328:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428524544 00000100:00100000:0.0:1790772102.112387:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790772102.112398:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428524544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772102.112439:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772102.112504:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428524544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772102.112510:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1790772102.112601:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2746c0e00 x1877760428524544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772102.112619:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428524544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772102.176585:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772102.698156:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772102.698246:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412760704 00000100:00100000:1.0:1790772102.698256:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412760704 00000100:00100000:1.0:1790772102.698307:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 228 00000100:00100000:1.0:1790772102.698317:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:5589:x1877760412760704:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772102.698333:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772102.698361:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f22697f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.698389:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22697f expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.698402:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22697f expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.698411:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9800, rc 0) 00000100:00100000:1.0:1790772102.698468:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412760704:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 153us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772102.698476:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 228 00000100:00100000:3.0:1790772102.705095:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772102.705170:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412760832 00000100:00100000:2.0:1790772102.705179:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412760832 00000100:00100000:2.0:1790772102.705238:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 229 00000100:00100000:2.0:1790772102.705247:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412760832:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772102.705528:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412760832:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 280us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772102.705536:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 229 00000100:00100000:3.0:1790772102.712696:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772102.716931:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412760960 00000100:00100000:2.0:1790772102.716958:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412760960 00000100:00100000:2.0:1790772102.717027:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 230 00000100:00100000:2.0:1790772102.717037:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412760960:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772102.717479:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412760960:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 442us (4790us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772102.717487:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 230 00000100:00100000:3.0:1790772102.727221:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772102.727328:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412761088 00000100:00100000:1.0:1790772102.727339:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412761088 00000100:00100000:1.0:1790772102.727406:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 231 00000100:00100000:1.0:1790772102.727416:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412761088:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772102.727433:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772102.727451:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226986 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.727509:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226986 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.727522:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226986 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.727530:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9e00, rc 0) 00000100:00100000:1.0:1790772102.727638:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:5589:x1877760412761088:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 223us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772102.727645:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 231 00000100:00100000:0.0:1790772102.740700:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772102.740798:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412761216 00000100:00100000:2.0:1790772102.740808:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412761216 00000100:00100000:2.0:1790772102.740865:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 232 00000100:00100000:2.0:1790772102.740889:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:5589:x1877760412761216:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772102.741161:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:5589:x1877760412761216:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 273us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772102.741169:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 232 00000100:00100000:3.0:1790772102.750502:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772102.750656:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412761344 00000100:00100000:2.0:1790772102.750665:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412761344 00000100:00100000:2.0:1790772102.750724:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 233 00000100:00100000:2.0:1790772102.750733:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:5589:x1877760412761344:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772102.750944:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:5589:x1877760412761344:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 201us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772102.750952:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 233 10000000:01000000:3.0:1790772102.815782:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790772102.815790:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df273e99800 from 7 10000000:01000000:3.0:1790772102.815795:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790772102.815840:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772102.815852:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772102.815863:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772102.815897:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f648e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428524672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772102.815972:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772102.816045:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772102.816097:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428524672 00000100:00100000:1.0:1790772102.816105:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428524672 00000100:00100000:1.0:1790772102.816157:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1790772102.816166:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428524672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772102.816178:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772102.816189:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a8ff62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8ff5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.816210:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a8ff62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff5b expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.816232:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a8ff62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff5b expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.816241:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8e00, rc 0) 00000100:00100000:1.0:1790772102.816289:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428524672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772102.816310:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1790772102.816418:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f648e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428524672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772102.816433:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772102.816441:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772102.816501:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428524800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772102.816528:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772102.816575:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f78000 going to sleep for 11 seconds 00000100:00100000:1.0:1790772102.816916:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428524800 00000100:00100000:1.0:1790772102.816920:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428524800 00000100:00100000:1.0:1790772102.816965:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790772102.816972:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428524800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772102.817187:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428524800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772102.817194:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790772102.817235:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428524800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772102.817263:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428524928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772102.817298:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772102.817317:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1240 going to sleep for 11 seconds 00000100:00100000:1.0:1790772102.817328:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428524928 00000100:00100000:1.0:1790772102.817331:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428524928 00000100:00100000:1.0:1790772102.817361:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790772102.817368:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428524928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772102.817491:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428524928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772102.817497:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790772102.817531:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428524928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790772102.818196:0:11170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790772102.818256:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790772102.818271:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772102.818280:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.818297:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772102.818307:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790772102.818309:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df242cf1800 from 7 10000000:01000000:1.0:1790772102.818311:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772102.818333:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.818341:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.818350:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772102.818363:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772102.818400:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772102.818416:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772102.818430:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428525056 00000100:00100000:1.0:1790772102.818434:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428525056 00000100:00100000:1.0:1790772102.818456:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1790772102.818463:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428525056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772102.818471:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772102.818481:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b8a00/0xdf68d9a7d6a8ff70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8ff69 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.818500:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b8a00/0xdf68d9a7d6a8ff70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff69 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.818519:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b8a00/0xdf68d9a7d6a8ff70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff69 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.818527:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8a00, rc 0) 00000100:00100000:1.0:1790772102.818580:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428525056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772102.818587:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1790772102.818617:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772102.818628:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772102.818635:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772102.818671:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772102.818695:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772102.818707:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772102.818717:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428525184 00000100:00100000:1.0:1790772102.818721:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428525184 00000100:00100000:1.0:1790772102.818737:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1790772102.818742:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428525184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772102.818908:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428525184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772102.818915:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1790772102.818954:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772102.818985:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772102.819017:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772102.819030:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772102.819040:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428525312 00000100:00100000:1.0:1790772102.819043:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428525312 00000100:00100000:1.0:1790772102.819059:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790772102.819064:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428525312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772102.819177:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428525312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772102.819184:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790772102.819218:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790772102.826130:0:11171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790772102.826312:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790772102.826333:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772102.826345:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772102.826368:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772102.826379:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772102.826381:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df258965000 from 7 10000000:01000000:0.0:1790772102.826384:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772102.826420:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772102.826428:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772102.826439:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772102.826462:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772102.826526:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772102.826595:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772102.826735:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428525440 00000100:00100000:3.0:1790772102.826743:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428525440 00000100:00100000:3.0:1790772102.826782:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790772102.826791:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428525440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772102.826803:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772102.826814:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2414a3400/0xdf68d9a7d6a8ff7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a8ff77 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772102.826836:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2414a3400/0xdf68d9a7d6a8ff7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff77 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772102.826846:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2414a3400/0xdf68d9a7d6a8ff7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff77 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772102.826854:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3400, rc 0) 00000100:00100000:3.0:1790772102.826897:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428525440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772102.826903:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1790772102.826988:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772102.827009:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772102.827018:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772102.827062:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772102.827085:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772102.827113:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772102.827126:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428525568 00000100:00100000:0.0:1790772102.827130:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428525568 00000100:00100000:0.0:1790772102.827155:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1790772102.827160:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428525568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772102.827399:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428525568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772102.827406:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1790772102.827435:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772102.827459:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772102.827495:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772102.827508:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772102.827519:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428525696 00000100:00100000:0.0:1790772102.827523:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428525696 00000100:00100000:0.0:1790772102.827539:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1790772102.827545:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428525696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772102.827697:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428525696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772102.827712:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1790772102.827747:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428525696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790772102.828351:0:11172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790772102.828396:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790772102.828408:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772102.828416:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772102.828425:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772103.206714:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772104.225328:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772105.248334:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772106.273141:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772106.720866:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428525824:0@lo:400:kworker.0 00000100:00100000:0.0:1790772106.720956:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772106.721000:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428526336:0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.721144:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428526080:0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.721244:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772106.721266:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428526592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772106.721289:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772106.721312:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772106.721318:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428526208:0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.721340:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772106.721368:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428525952:0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.721392:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772106.721406:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428526464:0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.721436:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772106.721597:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428526080 00000100:00100000:1.0:1790772106.721606:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428526080 00000100:00100000:1.0:1790772106.721661:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428525952 00000100:00100000:1.0:1790772106.721665:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428525952 00000100:00100000:1.0:1790772106.721686:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790772106.721694:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428526080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.721745:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428526080:12345-0@lo:400:kworker.0 Request processed in 52us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772106.721752:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790772106.721767:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790772106.721773:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428525952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.721804:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428525952:12345-0@lo:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772106.721810:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790772106.721826:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428525824 00000100:00100000:1.0:1790772106.721830:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428525824 00000100:00100000:1.0:1790772106.721852:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790772106.721858:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428525824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.721888:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428525824:12345-0@lo:400:kworker.0 Request processed in 29us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772106.721893:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790772106.721952:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428525952:0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.721977:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428526080:0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.722006:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428526208 00000100:00100000:1.0:1790772106.722010:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428526208 00000100:00080000:3.0:1790772106.723145:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772106.724271:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428526464 00000100:00100000:1.0:1790772106.724279:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428526464 00000100:00100000:1.0:1790772106.724304:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790772106.724312:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428526208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.724392:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428526208:12345-0@lo:400:kworker.0 Request processed in 80us (3049us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772106.724399:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790772106.724414:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790772106.724420:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428526464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.724454:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428526464:12345-0@lo:400:kworker.0 Request processed in 34us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772106.724460:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790772106.724485:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428526592 00000100:00100000:1.0:1790772106.724489:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428526592 00000100:00100000:1.0:1790772106.724510:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790772106.724516:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428526592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772106.724541:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772106.724589:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428526592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (3298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772106.724595:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1790772106.724633:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2746c0380 x1877760428526464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772106.724646:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428526464:0@lo:400:kworker.0 00010000:00080000:1.0:1790772106.724675:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2746c1f80 x1877760428526208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772106.724684:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428526208:0@lo:400:kworker.0 00010000:00080000:1.0:1790772106.724702:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258e84e00 x1877760428526592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772106.724715:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428526592:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790772106.726397:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772106.726405:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772106.727221:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772106.727269:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428526336 00000100:00100000:1.0:1790772106.727277:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428526336 00000100:00100000:1.0:1790772106.727335:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790772106.727343:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428526336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.727392:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428526336:12345-0@lo:400:kworker.0 Request processed in 50us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772106.727399:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790772106.727444:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428526336:0@lo:400:kworker.0 00000100:00100000:1.0:1790772106.727467:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428525824:0@lo:400:kworker.0 00000100:00080000:0.0:1790772106.728431:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772106.794738:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772106.794768:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772106.794790:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772106.794816:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412761472 00000100:00100000:3.0:1790772106.794824:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412761472 00000100:00100000:3.0:1790772106.794866:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 244 00000100:00100000:3.0:1790772106.794874:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412761472:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772106.794950:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412761472:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772106.794957:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 244 00000100:00100000:3.0:1790772106.794987:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412761600 00000100:00100000:3.0:1790772106.794991:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412761600 00000100:00100000:2.0:1790772106.795299:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412761728 00000100:00100000:2.0:1790772106.795304:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412761728 00000100:00100000:3.0:1790772106.796312:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:3.0:1790772106.796323:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412761600:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772106.796372:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412761600:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 52us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772106.796379:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:2.0:1790772106.808029:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 95 00000100:00100000:2.0:1790772106.808049:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412761728:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772106.808149:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412761728:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 109us (13357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772106.808157:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 95 00000100:00080000:1.0:1790772106.809606:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1790772106.874483:0:11349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1790772107.234465:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428526720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772107.234531:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772107.234585:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428526720 00000100:00100000:0.0:1790772107.234593:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428526720 00000100:00100000:0.0:1790772107.234707:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790772107.234716:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428526720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772107.234751:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772107.234796:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428526720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772107.234802:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1790772107.235010:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2746c1180 x1877760428526720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772107.235039:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428526720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772107.300278:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772108.320007:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772109.344742:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772110.368341:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790772111.050312:0:11448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:41:48 (1790772108) === 00000100:00100000:3.0:1790772111.315097:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772111.315142:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772111.315984:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412761856 00000100:00100000:0.0:1790772111.315996:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412761856 00000100:00100000:0.0:1790772111.316079:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1790772111.316108:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2349:x1877760412761856:12345-192.168.206.27@tcp:41:mkdir.0 00000004:00000024:0.0:1790772111.316152:0:5824:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790772111.316233:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2349:x1877760412761856:12345-192.168.206.27@tcp:41:mkdir.0 Request processed in 128us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772111.316241:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:1.0:1790772111.316428:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412761984 00000100:00100000:1.0:1790772111.316434:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412761984 00000100:00100000:1.0:1790772111.316471:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:1.0:1790772111.316478:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:9678:x1877760412761984:12345-192.168.206.27@tcp:700:mkdir.0 00000100:00100000:1.0:1790772111.316515:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:9678:x1877760412761984:12345-192.168.206.27@tcp:700:mkdir.0 Request processed in 39us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772111.316521:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00080000:2.0:1790772111.316628:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772111.321143:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772111.321306:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412762240 00000100:00100000:1.0:1790772111.321315:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412762240 00000100:00100000:1.0:1790772111.321374:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:1.0:1790772111.321384:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:9678:x1877760412762240:12345-192.168.206.27@tcp:36:mkdir.0 00010000:00010000:1.0:1790772111.321443:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772111.321540:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a8fe66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226908 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.321604:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df254043c00) 00010000:00010000:1.0:1790772111.321616:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772111.321951:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ff85 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.321965:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ff85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.321974:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ff85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.321987:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.321994:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.322001:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772111.325496:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790772111.325514:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ff85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.325534:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ff85 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.325541:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ff85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.325573:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772111.325580:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ff85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.325588:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ff85 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.325602:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df27c001d00) 00010000:00010000:1.0:1790772111.325605:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772111.325609:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ff85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.325615:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ff85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772111.325634:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c13ea906 reply state 0000000014da5edd transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772111.325643:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772111.325812:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:9678:x1877760412762240:12345-192.168.206.27@tcp:36:mkdir.0 Request processed in 4425us (4674us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790772111.325820:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00010000:00010000:1.0:1790772111.331218:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.331253:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.331261:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.331267:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772111.331272:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.331280:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.331296:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df27c001600) 00010000:00010000:1.0:1790772111.331299:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772111.331303:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.331309:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ff8c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772111.356366:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772111.356518:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412762368 00000100:00100000:0.0:1790772111.356528:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412762368 00000100:00100000:2.0:1790772111.357111:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:2.0:1790772111.357123:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:9679:x1877760412762368:12345-192.168.206.27@tcp:101:chmod.0 00010000:00010000:2.0:1790772111.357143:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772111.357168:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ff93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f22698d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.357259:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a8ff9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.357272:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a8ff9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.357282:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a8ff9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772111.357318:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772111.357322:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772111.357357:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a8ff9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.357382:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ff93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22698d expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.357401:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a8ff9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22698d expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.357410:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57300) 00010000:00010000:2.0:1790772111.357413:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772111.357416:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241390800, rc 0) 00000100:00100000:2.0:1790772111.357477:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:9679:x1877760412762368:12345-192.168.206.27@tcp:101:chmod.0 Request processed in 356us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772111.357484:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:3.0:1790772111.365457:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.365844:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412762624 00000100:00100000:2.0:1790772111.365864:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412762624 00000100:00100000:2.0:1790772111.365945:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:2.0:1790772111.365955:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:9679:x1877760412762624:12345-192.168.206.27@tcp:36:chmod.0 00010000:00010000:2.0:1790772111.366011:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772111.366036:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a8ff9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22698d expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.366054:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57300) 00010000:00010000:2.0:1790772111.366064:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772111.366090:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.366102:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.366111:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772111.366380:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005fe2724d reply state 000000000c5d6867 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772111.366390:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790772111.366400:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790772111.366483:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:9679:x1877760412762624:12345-192.168.206.27@tcp:36:chmod.0 Request processed in 529us (1034us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790772111.366490:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00010000:00010000:1.0:1790772111.376140:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.376157:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.376164:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.376171:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772111.376190:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.376198:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.376212:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57e00) 00010000:00010000:1.0:1790772111.376215:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790772111.376220:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.376226:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffa1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.391883:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772111.413143:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.414465:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412762752 00000100:00100000:2.0:1790772111.414477:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412762752 00000100:00100000:2.0:1790772111.414547:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:2.0:1790772111.414594:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:9680:x1877760412762752:12345-192.168.206.27@tcp:101:chown.0 00010000:00010000:2.0:1790772111.414630:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772111.414650:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a8ffa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226994 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.414719:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.414731:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.414741:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772111.414915:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772111.414920:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772111.414972:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.415001:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a8ffa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226994 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.415020:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226994 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.415029:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57300) 00010000:00010000:2.0:1790772111.415032:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772111.415035:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241390c00, rc 0) 00000100:00100000:2.0:1790772111.415144:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:9680:x1877760412762752:12345-192.168.206.27@tcp:101:chown.0 Request processed in 551us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772111.415151:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:1.0:1790772111.424101:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772111.424481:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412762880 00000100:00100000:3.0:1790772111.424490:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412762880 00000100:00100000:3.0:1790772111.425133:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:3.0:1790772111.425145:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:9680:x1877760412762880:12345-192.168.206.27@tcp:101:chown.0 00010000:00010000:3.0:1790772111.425165:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772111.425471:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a8ffb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f22699b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425542:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a8ffbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425675:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a8ffbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425689:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a8ffbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425710:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8ffc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425732:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8ffc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425740:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8ffc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425829:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a8ffcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425837:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a8ffcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425844:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a8ffcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772111.425875:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772111.425878:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772111.425910:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a8ffcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425922:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a8ffbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425929:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a8ffbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425935:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a8ffbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.425942:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772111.426075:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a8ffbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426090:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a8ffbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426101:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57300) 00010000:00010000:3.0:1790772111.426104:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772111.426109:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a8ffbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426114:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a8ffbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426127:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8ffc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426132:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8ffc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426137:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8ffc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426141:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772111.426143:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8ffc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426148:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8ffc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426153:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df247e07300) 00010000:00010000:3.0:1790772111.426155:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772111.426157:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8ffc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426537:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8ffc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426706:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a8ffb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22699b expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426721:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a8ffcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22699b expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.426729:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df247e07100) 00010000:00010000:3.0:1790772111.426731:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772111.426734:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3200, rc 0) 00000100:00100000:3.0:1790772111.426848:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:9680:x1877760412762880:12345-192.168.206.27@tcp:101:chown.0 Request processed in 1705us (2754us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772111.426856:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:0.0:1790772111.432213:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.432522:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412763136 00000100:00100000:2.0:1790772111.432532:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412763136 00000100:00100000:2.0:1790772111.432639:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:2.0:1790772111.432649:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:9680:x1877760412763136:12345-192.168.206.27@tcp:36:chown.0 00010000:00010000:2.0:1790772111.432708:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772111.432734:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a8ffcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22699b expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.432754:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df247e07100) 00010000:00010000:2.0:1790772111.432764:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772111.432790:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.432802:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.432811:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772111.491223:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1790772111.491242:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1790772111.491684:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000527cfb59 reply state 0000000064d1fd98 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772111.491698:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790772111.491714:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1790772111.491906:0:5824:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790772111.491932:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:9680:x1877760412763136:12345-192.168.206.27@tcp:36:chown.0 Request processed in 59280us (59723us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790772111.491941:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00010000:00010000:0.0:1790772111.492040:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.492050:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.492057:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.492063:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772111.492068:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.492076:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.492089:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df251c57400) 00010000:00010000:0.0:1790772111.492092:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790772111.492097:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.492104:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a8ffd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772111.518160:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772111.518720:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412763264 00000100:00100000:1.0:1790772111.518730:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412763264 00000100:00100000:1.0:1790772111.518790:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:1.0:1790772111.518798:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:9681:x1877760412763264:12345-192.168.206.27@tcp:101:touch.500 00010000:00010000:1.0:1790772111.518820:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772111.518839:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ffd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790772111.522080:0:5825:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3176us 00010000:00010000:1.0:1790772111.536699:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ffe0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.536722:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ffe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.537284:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ffe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.537306:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a8ffe7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.537314:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a8ffe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.537333:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a8ffe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541777:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a8ffee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541795:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a8ffee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541807:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a8ffee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772111.541841:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790772111.541846:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772111.541886:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a8ffee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541911:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ffe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541918:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ffe0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541938:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ffe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541944:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772111.541948:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ffe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541956:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ffe0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541967:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57300) 00010000:00010000:1.0:1790772111.541972:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772111.541976:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ffe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541983:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a8ffe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541993:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a8ffe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.541999:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a8ffe7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.542004:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a8ffe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.542009:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772111.542012:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a8ffe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.542027:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a8ffe7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.542036:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df27c001d00) 00010000:00010000:1.0:1790772111.542039:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772111.542042:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a8ffe7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.542048:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a8ffe7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.542088:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a8ffd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269a2 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.542104:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a8ffee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269a2 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.542111:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df27c001600) 00010000:00010000:1.0:1790772111.542113:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790772111.542115:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8800, rc 0) 00000100:00100000:1.0:1790772111.542194:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:9681:x1877760412763264:12345-192.168.206.27@tcp:101:touch.500 Request processed in 23395us (24041us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772111.542203:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:3.0:1790772111.546461:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.548013:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412763520 00000100:00100000:2.0:1790772111.558077:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412763520 00000100:00100000:3.0:1790772111.558327:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:3.0:1790772111.558338:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:9681:x1877760412763520:12345-192.168.206.27@tcp:101:touch.500 00010000:00010000:3.0:1790772111.558371:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772111.558393:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a8fff5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269a9 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.558786:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8fffc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.558801:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8fffc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.558811:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8fffc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.561731:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.561751:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.561764:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790772111.564189:0:6701:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1790772111.564498:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9000a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.564515:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.564526:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.564812:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8fffc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.564821:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8fffc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.564828:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8fffc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.564834:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772111.564839:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8fffc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.564846:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8fffc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.564857:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df27c001600) 00010000:00010000:3.0:1790772111.564861:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772111.564865:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8fffc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.564872:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a8fffc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772111.564897:0:6701:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000612e8739 reply state 000000003c3c4370 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772111.564907:0:6701:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790772111.565161:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a8fff5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269a9 expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.565298:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9000a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269a9 expref: 9 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.565306:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df247e07c00) 00010000:00010000:3.0:1790772111.565308:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772111.565311:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3200, rc 0) 00000100:00100000:3.0:1790772111.565439:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:9681:x1877760412763520:12345-192.168.206.27@tcp:101:touch.500 Request processed in 7102us (18985us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790772111.565449:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 22 00010000:00010000:1.0:1790772111.574586:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.574603:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.574629:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.574636:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772111.574642:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.574650:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.574667:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff8df247e07300) 00010000:00010000:1.0:1790772111.574670:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772111.574675:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.574680:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90003 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772111.580488:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.580615:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412763776 00000100:00100000:2.0:1790772111.580624:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412763776 00000100:00100000:2.0:1790772111.580676:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:2.0:1790772111.580686:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:9681:x1877760412763776:12345-192.168.206.27@tcp:36:touch.500 00010000:00010000:2.0:1790772111.580743:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772111.580766:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9000a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269a9 expref: 9 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.580804:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df247e07c00) 00010000:00010000:2.0:1790772111.580814:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772111.580852:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.580864:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.580873:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772111.581027:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d68e13ed reply state 00000000e078c6e6 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772111.581048:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772111.581142:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:9681:x1877760412763776:12345-192.168.206.27@tcp:36:touch.500 Request processed in 457us (662us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790772111.581150:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00010000:00010000:3.0:1790772111.584800:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.584817:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.584825:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.584832:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772111.584838:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.584846:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.584861:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df251c57600) 00010000:00010000:3.0:1790772111.584864:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772111.584883:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.584904:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a90018 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772111.592242:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.592421:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412763904 00000100:00100000:2.0:1790772111.592432:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412763904 00000100:00100000:2.0:1790772111.592488:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:2.0:1790772111.592499:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:9681:x1877760412763904:12345-192.168.206.27@tcp:101:touch.500 00010000:00010000:2.0:1790772111.592523:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772111.592583:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a9001f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269b0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.592642:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a9001f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269b0 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.592677:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a9001f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269b0 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.592700:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df251c57200) 00010000:00010000:2.0:1790772111.592704:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772111.592707:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241391c00, rc 0) 00000100:00100000:2.0:1790772111.592753:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:9681:x1877760412763904:12345-192.168.206.27@tcp:101:touch.500 Request processed in 257us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772111.592760:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:0.0:1790772111.601158:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772111.601401:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412764032 00000100:00100000:1.0:1790772111.601411:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412764032 00000100:00100000:1.0:1790772111.601459:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:1.0:1790772111.601466:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1877760412764032:12345-192.168.206.27@tcp:8:touch.500 00010000:00080000:1.0:1790772111.601497:0:6678:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:1.0:1790772111.601525:0:6678:0:(genops.c:1384:class_connect()) connect: client 9271f5fd-fa87-4f6b-a8bf-0936e195e8be, cookie 0xdf68d9a7d6a90026 00002000:00100000:1.0:1790772111.601537:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9271f5fd-fa87-4f6b-a8bf-0936e195e8be/ffff8df259053800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790772111.601601:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790772111.601801:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790772111.601836:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8df259050800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772111.601912:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2346:x1877760412764032:12345-192.168.206.27@tcp:8:touch.500 Request processed in 444us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772111.601920:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:0.0:1790772111.609625:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772111.609707:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412764160 00000100:00100000:1.0:1790772111.609717:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412764160 00000100:00100000:1.0:1790772111.609786:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:1.0:1790772111.609796:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:0:x1877760412764160:12345-192.168.206.27@tcp:2:touch.500 00000100:00080000:2.0:1790772111.610384:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1790772111.646644:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1790772111.646659:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000100:00100000:0.0:1790772111.646811:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:0:x1877760412764160:12345-192.168.206.27@tcp:2:touch.500 Request processed in 37011us (37189us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790772111.646821:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:0.0:1790772111.649030:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772111.649240:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412764416 00000100:00100000:3.0:1790772111.649250:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412764416 00000100:00100000:3.0:1790772111.649342:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:3.0:1790772111.649352:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:9681:x1877760412764416:12345-192.168.206.27@tcp:35:touch.500 00000100:00100000:3.0:1790772111.649687:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:9681:x1877760412764416:12345-192.168.206.27@tcp:35:touch.500 Request processed in 336us (664us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790772111.649696:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:1.0:1790772111.667684:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.667787:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412764544 00000100:00100000:2.0:1790772111.667796:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412764544 00000100:00100000:2.0:1790772111.667853:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:2.0:1790772111.667863:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:9682:x1877760412764544:12345-192.168.206.27@tcp:101:rm.0 00010000:00010000:2.0:1790772111.667887:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772111.667923:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9002d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269b7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.668005:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a90034 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.668019:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a90034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.668029:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a90034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772111.668089:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772111.668093:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772111.668131:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a90034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.668158:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9002d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269b7 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.668197:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a90034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269b7 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.668206:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df27c001600) 00010000:00010000:2.0:1790772111.668209:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772111.668212:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241390800, rc 0) 00000100:00100000:2.0:1790772111.668274:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+12:9682:x1877760412764544:12345-192.168.206.27@tcp:101:rm.0 Request processed in 412us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772111.668281:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:1.0:1790772111.678362:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.678461:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412764800 00000100:00100000:2.0:1790772111.678470:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412764800 00000100:00100000:2.0:1790772111.678529:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:2.0:1790772111.678538:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+12:9682:x1877760412764800:12345-192.168.206.27@tcp:101:rm.0 00010000:00010000:2.0:1790772111.678584:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772111.678605:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9003b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269be expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772111.678699:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790772111.678842:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9003b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269be expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.678862:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57300) 00010000:00010000:2.0:1790772111.678865:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772111.678870:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9003b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269be expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.678884:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241391a00, rc 0) 00000100:00100000:2.0:1790772111.678945:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:9682:x1877760412764800:12345-192.168.206.27@tcp:101:rm.0 Request processed in 408us (592us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1790772111.678952:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:0.0:1790772111.684801:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772111.684960:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412764928 00000100:00100000:3.0:1790772111.684969:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412764928 00000100:00100000:3.0:1790772111.685021:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:3.0:1790772111.685030:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:9682:x1877760412764928:12345-192.168.206.27@tcp:37:rm.0 00000100:00100000:3.0:1790772111.695285:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:9682:x1877760412764928:12345-192.168.206.27@tcp:37:rm.0 Request processed in 10245us (10480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772111.695298:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:1.0:1790772111.701275:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.702509:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412765184 00000100:00100000:2.0:1790772111.702520:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412765184 00000100:00100000:2.0:1790772111.702639:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:2.0:1790772111.702650:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25dbd0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:9682:x1877760412765184:12345-192.168.206.27@tcp:35:rm.0 00000100:00100000:2.0:1790772111.702875:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25dbd0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:9682:x1877760412765184:12345-192.168.206.27@tcp:35:rm.0 Request processed in 226us (1607us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790772111.702883:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:0.0:1790772111.709507:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.709646:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412765440 00000100:00100000:2.0:1790772111.709656:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412765440 00000100:00100000:2.0:1790772111.709763:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:2.0:1790772111.709773:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:9682:x1877760412765440:12345-192.168.206.27@tcp:101:rm.0 00010000:00010000:2.0:1790772111.709796:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772111.709815:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a90049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269c5 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.709955:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa600/0xdf68d9a7d6a90050 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.709975:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa600/0xdf68d9a7d6a90050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.709987:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa600/0xdf68d9a7d6a90050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772111.713288:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790772111.713460:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a90049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269c5 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.713486:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa600/0xdf68d9a7d6a90050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269c5 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.713496:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df27c001600) 00010000:00010000:2.0:1790772111.713499:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790772111.713502:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa600, rc 0) 00000100:00100000:2.0:1790772111.713614:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:9682:x1877760412765440:12345-192.168.206.27@tcp:101:rm.0 Request processed in 3842us (4115us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790772111.713623:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:1.0:1790772111.722757:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.722944:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412765568 00000100:00100000:2.0:1790772111.722954:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412765568 00000100:00100000:2.0:1790772111.723132:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:2.0:1790772111.723143:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:9682:x1877760412765568:12345-192.168.206.27@tcp:41:rm.0 00000004:00000024:2.0:1790772111.723374:0:5824:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1790772111.723446:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:9682:x1877760412765568:12345-192.168.206.27@tcp:41:rm.0 Request processed in 305us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772111.723454:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:1.0:1790772111.727429:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772111.728409:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412765696 00000100:00100000:0.0:1790772111.728419:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412765696 00000100:00100000:0.0:1790772111.728486:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:0.0:1790772111.728497:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:9682:x1877760412765696:12345-192.168.206.27@tcp:101:rm.0 00010000:00010000:0.0:1790772111.728516:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772111.728536:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8800/0xdf68d9a7d6a9005e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269cc expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.728629:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90065 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.728644:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.728655:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.728670:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9006c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.728699:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9006c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.728707:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9006c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.728830:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.728840:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.728847:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772111.728880:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790772111.728885:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772111.728923:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.728937:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.734591:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.734608:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90065 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.738950:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.739069:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772111.739074:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.739083:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90065 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.739099:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df27c001600) 00010000:00010000:0.0:1790772111.739101:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772111.740176:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90065 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740191:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740210:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9006c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740216:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9006c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740223:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9006c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740228:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772111.740232:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9006c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740238:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9006c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740266:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff8df254043e00) 00010000:00010000:0.0:1790772111.740267:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772111.740270:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9006c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740274:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9006c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740321:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8800/0xdf68d9a7d6a9005e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269cc expref: 18 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740330:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269cc expref: 17 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.740335:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df251c57200) 00010000:00010000:0.0:1790772111.740336:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772111.740338:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8a00, rc 0) 00000100:00100000:0.0:1790772111.740392:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:9682:x1877760412765696:12345-192.168.206.27@tcp:101:rm.0 Request processed in 11897us (12970us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772111.740398:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:0.0:1790772111.756657:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772111.756772:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412765952 00000100:00100000:1.0:1790772111.756781:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412765952 00000100:00100000:1.0:1790772111.756840:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00100000:1.0:1790772111.756850:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:9682:x1877760412765952:12345-192.168.206.27@tcp:36:rm.0 00010000:00010000:1.0:1790772111.756922:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790772111.756960:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269cc expref: 17 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.756982:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a9001f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269b0 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.757005:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df251c57200) 00010000:00010000:1.0:1790772111.757023:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a90034 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269b7 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.757079:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df27c001600) 00010000:00010000:1.0:1790772111.757084:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772111.757105:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9007a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.757118:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9007a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.757128:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9007a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.757144:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.757152:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.757158:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.757276:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90088 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.757285:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90088 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.757292:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90088 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772111.758063:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1790772111.758075:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 277902524468ns, next at 278902521975ns, rc = 0 00010000:00010000:1.0:1790772111.758140:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758151:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758160:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758167:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758173:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758180:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758197:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772111.758224:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90088 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758230:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90088 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758237:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90088 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758244:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772111.758249:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90088 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758256:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90088 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758273:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df27c001b00) 00010000:00010000:1.0:1790772111.758276:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790772111.758280:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90088 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758286:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90088 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758301:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9007a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758306:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9007a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758311:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9007a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758316:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772111.758319:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9007a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758325:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9007a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758331:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df27c001600) 00010000:00010000:1.0:1790772111.758334:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772111.758336:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9007a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772111.758342:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9007a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772111.758360:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000056fb7b43 reply state 000000000fbd5482 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772111.758369:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772111.758451:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:9682:x1877760412765952:12345-192.168.206.27@tcp:36:rm.0 Request processed in 1601us (1802us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790772111.758459:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 30 00010000:00010000:0.0:1790772111.760034:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772111.760049:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.760058:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772111.760062:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.760479:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.760496:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df27c001b00) 00010000:00010000:0.0:1790772111.760499:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790772111.760503:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.760508:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9008f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.760532:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772111.760534:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772111.760536:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772111.766927:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.766945:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.766954:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.766960:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772111.766965:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.766973:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.766990:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff8df27c001d00) 00010000:00010000:0.0:1790772111.767113:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772111.767120:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772111.767127:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90081 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772111.767528:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772111.768589:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412766208 00000100:00100000:3.0:1790772111.768738:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412766208 00000100:00100000:3.0:1790772111.768794:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:3.0:1790772111.768804:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:9682:x1877760412766208:12345-192.168.206.27@tcp:35:rm.0 00000100:00100000:3.0:1790772111.769121:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:9682:x1877760412766208:12345-192.168.206.27@tcp:35:rm.0 Request processed in 317us (1596us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790772111.769144:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:1.0:1790772111.772814:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772111.773298:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412766464 00000100:00100000:2.0:1790772111.773307:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412766464 00000100:00100000:2.0:1790772111.773939:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:2.0:1790772111.773963:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:9682:x1877760412766464:12345-192.168.206.27@tcp:36:rm.0 00010000:00010000:2.0:1790772111.774046:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790772111.774081:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa600/0xdf68d9a7d6a90050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269c5 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774103:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a8ffee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269a2 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774114:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df27c001600) 00010000:00010000:2.0:1790772111.774130:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a8ffaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226994 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774138:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57300) 00010000:00010000:2.0:1790772111.774145:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772111.774181:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90096 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774202:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90096 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774212:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90096 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774224:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774231:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774249:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774457:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa000/0xdf68d9a7d6a900a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774466:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa000/0xdf68d9a7d6a900a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.774473:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa000/0xdf68d9a7d6a900a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772111.775064:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790772111.775082:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa000/0xdf68d9a7d6a900a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775091:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa000/0xdf68d9a7d6a900a4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775097:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa000/0xdf68d9a7d6a900a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775103:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772111.775108:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa000/0xdf68d9a7d6a900a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775116:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa000/0xdf68d9a7d6a900a4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775125:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df251c57400) 00010000:00010000:2.0:1790772111.775128:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790772111.775139:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa000/0xdf68d9a7d6a900a4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775145:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa000/0xdf68d9a7d6a900a4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775164:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90096 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775170:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90096 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775176:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90096 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775181:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aae00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772111.775183:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90096 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775189:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90096 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775197:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57100) 00010000:00010000:2.0:1790772111.775199:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772111.775202:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90096 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772111.775207:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90096 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772111.775218:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000060fe97b reply state 00000000ba73f3b2 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772111.775236:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772111.775311:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:9682:x1877760412766464:12345-192.168.206.27@tcp:36:rm.0 Request processed in 1361us (2503us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790772111.775318:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 31 00010000:00010000:3.0:1790772111.785630:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.785650:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.785658:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.785665:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772111.785671:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.785678:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.785694:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df251c57600) 00010000:00010000:3.0:1790772111.785697:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772111.785701:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772111.785706:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9009d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772111.839899:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428526976:0@lo:400:kworker.0 00000100:00100000:0.0:1790772111.839956:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428527104:0@lo:400:kworker.0 00000100:00100000:3.0:1790772111.839966:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772111.840010:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428526848:0@lo:400:kworker.0 00000100:00100000:2.0:1790772111.840030:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428526976 00000100:00100000:2.0:1790772111.840037:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428526976 00000100:00100000:2.0:1790772111.840089:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790772111.840098:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428526976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772111.840585:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772111.840609:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428527488:0@lo:400:kworker.0 00000100:00100000:0.0:1790772111.840625:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772111.840634:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428527232:0@lo:400:kworker.0 00000100:00100000:3.0:1790772111.840643:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772111.840741:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772111.840752:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772111.840771:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428527104 00000100:00100000:0.0:1790772111.840775:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428527488 00000100:00100000:3.0:1790772111.840777:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428527104 00000100:00100000:1.0:1790772111.840780:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428527360:0@lo:400:kworker.0 00000100:00100000:0.0:1790772111.840780:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428527488 00000100:00100000:1.0:1790772111.840806:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772111.840822:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428527232 00000100:00100000:3.0:1790772111.840825:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428527360 00000100:00100000:0.0:1790772111.840826:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428527232 00000100:00100000:3.0:1790772111.840831:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428527360 00000100:00100000:0.0:1790772111.840853:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790772111.840861:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790772111.840866:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428527488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772111.840874:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790772111.840876:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428527104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772111.840885:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428527232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772111.840929:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428527488:12345-0@lo:400:kworker.0 Request processed in 67us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772111.840937:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790772111.840947:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428527104:12345-0@lo:400:kworker.0 Request processed in 75us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772111.840947:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428527232:12345-0@lo:400:kworker.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772111.840966:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790772111.840966:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790772111.840966:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428527616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772111.840994:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428526848 00000100:00100000:1.0:1790772111.840997:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428526848 00000100:00100000:0.0:1790772111.840997:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772111.841021:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00010000:00080000:0.0:1790772111.841023:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f551500 x1877760428527232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772111.841027:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428526848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772111.841036:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428527232:0@lo:400:kworker.0 00000100:00100000:0.0:1790772111.841046:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428527104:0@lo:400:kworker.0 00000100:00100000:1.0:1790772111.841059:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428526848:12345-0@lo:400:kworker.0 Request processed in 32us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772111.841064:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790772111.841078:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428527616 00000100:00100000:0.0:1790772111.841082:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428527616 00000100:00100000:1.0:1790772111.841097:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428526848:0@lo:400:kworker.0 00000100:00100000:0.0:1790772111.841105:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790772111.841110:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428527616:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772111.841119:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790772111.841131:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428527360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772111.841179:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428527360:12345-0@lo:400:kworker.0 Request processed in 52us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772111.841190:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428526976:12345-0@lo:400:kworker.0 Request processed in 1092us (1224us total) trans 0 rc 0/0 00002000:00000024:0.0:1790772111.841223:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772111.841246:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428527360:0@lo:400:kworker.0 00000100:00100000:0.0:1790772111.841272:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428527616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772111.841279:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790772111.841284:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790772111.841292:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428526976:0@lo:400:kworker.0 00010000:00080000:1.0:1790772111.841306:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f551c00 x1877760428527488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1790772111.841306:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f374000 x1877760428527616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790772111.841311:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772111.841319:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772111.841319:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428527488:0@lo:400:kworker.0 00000100:00100000:0.0:1790772111.841323:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428527616:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790772111.841324:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772111.841428:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790772111.912774:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772111.912877:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772111.912926:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772111.913003:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772111.913373:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412766720 00000100:00100000:3.0:1790772111.913383:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412766720 00000100:00100000:3.0:1790772111.913435:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412766976 00000100:00100000:3.0:1790772111.913438:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412766976 00000100:00100000:3.0:1790772111.913474:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:3.0:1790772111.913482:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:2350:x1877760412766720:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772111.913594:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:2350:x1877760412766720:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 112us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772111.913601:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:3.0:1790772111.913618:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 100 00000100:00100000:3.0:1790772111.913625:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412766976:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772111.913667:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412766976:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 43us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772111.913674:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 100 00000100:00080000:3.0:1790772111.913691:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772111.914360:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412766848 00000100:00100000:2.0:1790772111.914367:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412766848 00000100:00100000:2.0:1790772111.914415:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:2.0:1790772111.914424:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2350:x1877760412766848:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772111.914479:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2350:x1877760412766848:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 57us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772111.914486:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:0.0:1790772111.914934:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412766592 00000100:00100000:0.0:1790772111.914940:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412766592 00000100:00100000:0.0:1790772111.915020:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 246 00000100:00100000:0.0:1790772111.915030:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412766592:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772111.915078:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412766592:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 51us (2313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772111.915085:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 246 00000100:00100000:1.0:1790772112.352807:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428527744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772112.352924:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772112.353176:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428527744 00000100:00100000:3.0:1790772112.353186:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428527744 00000100:00100000:3.0:1790772112.353251:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790772112.353262:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428527744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772112.353291:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772112.358045:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428527744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4769us (5106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772112.358063:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1790772112.362116:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f552680 x1877760428527744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772112.362152:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428527744:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772112.416268:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772113.440704:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772114.463816:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772115.491290:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790772116.155738:0:11598:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1790772116.527682:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790772116.585156:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1790772116.585166:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1790772116.586401:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428527872:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790772116.586466:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772116.586676:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428527872 00000100:00100000:3.0:1790772116.586684:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428527872 00000100:00100000:3.0:1790772116.586741:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772116.586749:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428527872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790772116.586825:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1790772116.586910:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abd038f, atime: 0x6abd038f, ctime: 0x6abd038f, blocks: 0x1 00010000:00010000:3.0:1790772116.586919:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a900ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772116.586934:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1790772116.586938:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772116.586945:0:6679:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a900ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772116.586979:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a900ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772116.586990:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a900ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790772116.587078:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790772116.587281:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a900ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772116.587592:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790772116.588576:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3295:x1877760428527872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1801us (2084us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790772116.588586:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1790772116.588905:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df26f649c00/2, rc 0, transno 4294967300 00000100:00100000:2.0:1790772116.588912:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428527872:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1790772116.589368:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00010000:00010000:0.0:1790772116.589714:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772116.589722:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a900ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772116.589749:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2a00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772116.589754:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a900ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772116.589763:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a900ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772116.589782:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a900ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772116.589789:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a900ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772116.589810:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772116.589812:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772116.589813:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772116.960157:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428528384:0@lo:400:kworker.0 00000100:00100000:2.0:1790772116.960234:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772116.960284:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790772116.960290:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428528000:0@lo:400:kworker.0 00000100:00100000:2.0:1790772116.960326:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772116.960348:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428528512:0@lo:400:kworker.0 00000100:00100000:2.0:1790772116.960421:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772116.960446:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428528128:0@lo:400:kworker.0 00000100:00100000:2.0:1790772116.960467:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772116.960482:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428528640:0@lo:400:kworker.0 00000100:00100000:2.0:1790772116.960502:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772116.960519:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772116.960523:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428528256:0@lo:400:kworker.0 00000100:00100000:2.0:1790772116.960543:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772116.960675:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428528384 00000100:00100000:2.0:1790772116.960683:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428528384 00000100:00100000:2.0:1790772116.960728:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428528640 00000100:00100000:2.0:1790772116.960731:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428528640 00000100:00100000:2.0:1790772116.960753:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790772116.960761:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428528384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772116.960809:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428528384:12345-0@lo:400:kworker.0 Request processed in 49us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772116.960816:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790772116.960830:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772116.960836:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1877760428528640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772116.960884:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1877760428528640:12345-0@lo:400:kworker.0 Request processed in 48us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772116.960890:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772116.960926:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428528640:0@lo:400:kworker.0 00010000:00080000:2.0:1790772116.960966:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f551c00 x1877760428528384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772116.960977:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428528384:0@lo:400:kworker.0 00000100:00100000:1.0:1790772116.961287:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428528000 00000100:00100000:1.0:1790772116.961292:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428528000 00000100:00100000:1.0:1790772116.961321:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790772116.961328:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428528000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772116.961377:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428528000:12345-0@lo:400:kworker.0 Request processed in 50us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772116.961383:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:0.0:1790772116.961604:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772116.961655:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428528768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772116.961684:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772116.961715:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428528768 00000100:00100000:0.0:1790772116.961719:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428528768 00000100:00100000:0.0:1790772116.961745:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790772116.961751:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428528768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772116.961775:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772116.961809:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428528768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772116.961822:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1790772116.961852:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2746c0e00 x1877760428528768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772116.961886:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428528768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772116.967146:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428528512 00000100:00100000:3.0:1790772116.967160:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428528512 00000100:00080000:3.0:1790772116.967216:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772116.967280:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428528128 00000100:00100000:3.0:1790772116.967284:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428528128 00000100:00100000:3.0:1790772116.967298:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428528256 00000100:00100000:3.0:1790772116.967301:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428528256 00000100:00100000:3.0:1790772116.967324:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790772116.967332:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428528512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772116.967418:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428528512:12345-0@lo:400:kworker.0 Request processed in 87us (6996us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772116.967425:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790772116.967441:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790772116.967454:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428528128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772116.967511:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428528128:12345-0@lo:400:kworker.0 Request processed in 58us (7043us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772116.967517:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790772116.967531:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790772116.967536:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428528256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772116.967584:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428528256:12345-0@lo:400:kworker.0 Request processed in 47us (7039us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772116.967589:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1790772116.967602:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772116.967632:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428528256:0@lo:400:kworker.0 00000100:00100000:3.0:1790772116.967644:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428528128:0@lo:400:kworker.0 00000100:00100000:2.0:1790772116.969690:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428528000:0@lo:400:kworker.0 00000100:00100000:2.0:1790772116.969709:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428528512:0@lo:400:kworker.0 00000100:00100000:0.0:1790772117.036628:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772117.036666:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772117.036692:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772117.036720:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772117.036753:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412767104 00000100:00100000:0.0:1790772117.036762:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412767104 00000100:00100000:0.0:1790772117.036806:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 248 00000100:00100000:0.0:1790772117.036814:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412767104:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772117.036887:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412767104:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 72us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772117.036895:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 248 00000100:00100000:0.0:1790772117.036925:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412767360 00000100:00100000:0.0:1790772117.036929:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412767360 00000100:00100000:0.0:1790772117.036963:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:0.0:1790772117.036969:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412767360:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772117.037013:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412767360:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 43us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772117.037020:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:3.0:1790772117.038177:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412767232 00000100:00100000:3.0:1790772117.038195:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412767232 00000100:00100000:3.0:1790772117.038263:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412767488 00000100:00100000:3.0:1790772117.038267:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412767488 00000100:00100000:0.0:1790772117.038329:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 104 00000100:00100000:3.0:1790772117.038734:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 105 00000100:00100000:0.0:1790772117.046947:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412767232:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772117.048545:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412767232:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 10198us (11919us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772117.048723:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 104 00000100:00100000:3.0:1790772117.049196:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412767488:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772117.049368:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412767488:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 10624us (12700us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772117.049379:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 105 00000100:00080000:3.0:1790772117.050045:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772117.050053:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1790772117.108116:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1790772117.475967:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428528896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772117.476031:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772117.476100:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428528896 00000100:00100000:2.0:1790772117.476107:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428528896 00000100:00100000:2.0:1790772117.476161:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790772117.476170:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428528896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772117.476202:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772117.476244:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428528896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772117.476251:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790772117.476284:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1790772117.476289:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df26f649c00, transno 4294967300 00000100:00100000:2.0:1790772117.476306:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428528896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772117.541037:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790772117.560369:0:11649:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfd871a50 20000000:00000080:3.0:1790772117.560385:0:11649:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df27af61400 uarg=0000000000000000 20000000:01000000:3.0:1790772117.560420:0:11649:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790772117.560432:0:11649:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790772117.560436:0:11649:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1790772117.562319:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1790772117.562807:0:11649:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1790772117.577284:0:11649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1790772117.577334:0:11649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1790772117.577389:0:11649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1790772117.577406:0:11649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790772117.577424:0:11649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.577443:0:11649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22697f expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.577450:0:11649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226986 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.577458:0:11649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a8ff62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff5b expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.577464:0:11649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f9b8a00/0xdf68d9a7d6a8ff70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff69 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.577471:0:11649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2414a3400/0xdf68d9a7d6a8ff7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a8ff77 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.577478:0:11649:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.577516:0:11649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2414a3400/0xdf68d9a7d6a8ff7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff77 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.577531:0:11649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df2414a3400/0xdf68d9a7d6a8ff7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff77 expref: 18 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772117.577585:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f649c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1877760428529024:0@lo:104: 00000100:00100000:3.0:1790772117.577644:0:11649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772117.577706:0:11649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f9b8a00/0xdf68d9a7d6a8ff70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff69 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.577714:0:11649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df26f9b8a00/0xdf68d9a7d6a8ff70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff69 expref: 18 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772117.577721:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1877760428529152:0@lo:104: 00000100:00100000:0.0:1790772117.577727:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428529024 00000100:00100000:0.0:1790772117.577735:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428529024 00000100:00100000:3.0:1790772117.577742:0:11649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772117.577767:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428529152 00000100:00100000:0.0:1790772117.577770:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428529152 00000100:00100000:0.0:1790772117.577785:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790772117.577792:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:11649:x1877760428529024:12345-0@lo:104: 00010000:00010000:0.0:1790772117.577804:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.577851:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790772117.577951:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+4:11649:x1877760428529024:12345-0@lo:104: Request processed in 66us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772117.578017:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790772117.578050:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790772117.578058:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:11649:x1877760428529152:12345-0@lo:104: 00010000:00010000:0.0:1790772117.578075:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578131:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790772117.578137:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:11649:x1877760428529152:12345-0@lo:104: Request processed in 81us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772117.578143:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1790772117.578161:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772117.578166:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578181:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1790772117.578185:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578194:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772117.578202:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772117.578207:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772117.578246:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578253:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772117.578272:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578279:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8200/0xdf68d9a7d6a8ff77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578291:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772117.578294:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578301:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8600 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1790772117.578303:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578320:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772117.578327:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772117.578332:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790772117.578359:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578366:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772117.578381:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578388:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8600/0xdf68d9a7d6a8ff69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578397:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772117.578399:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772117.578401:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772117.578407:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772117.578423:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428529280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772117.578451:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772117.578503:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428529408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772117.578524:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772117.578589:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428529280 00000100:00100000:0.0:1790772117.578594:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428529280 00010000:00010000:0.0:1790772117.578621:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2414a3400/0xdf68d9a7d6a8ff7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff77 expref: 19 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772117.578649:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428529408 00000100:00100000:0.0:1790772117.578653:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428529408 00010000:00010000:0.0:1790772117.578664:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f9b8a00/0xdf68d9a7d6a8ff70 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff69 expref: 20 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772117.578681:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790772117.578687:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+20:3296:x1877760428529280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772117.578697:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772117.578702:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2414a3400/0xdf68d9a7d6a8ff7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff77 expref: 20 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578712:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2414a3400/0xdf68d9a7d6a8ff7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff77 expref: 20 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578725:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772117.578751:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+20:3296:x1877760428529280:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772117.578758:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790772117.578770:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790772117.578776:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428529408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772117.578783:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772117.578787:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f9b8a00/0xdf68d9a7d6a8ff70 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff69 expref: 19 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578795:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f9b8a00/0xdf68d9a7d6a8ff70 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff69 expref: 19 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.578803:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772117.578851:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428529408:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772117.579013:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1790772117.581073:0:11649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a8ff62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff5b expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.581090:0:11649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a8ff62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff5b expref: 18 pid: 5818 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772117.581104:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e307100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1877760428529536:0@lo:104: 00000100:00100000:0.0:1790772117.581430:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428529280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772117.581562:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428529408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772117.581985:0:11649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772117.582038:0:11649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226986 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.582051:0:11649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226986 expref: 12 pid: 5818 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772117.582077:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e304e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1877760428529664:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772117.582100:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428529536 00000100:00100000:0.0:1790772117.582106:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428529536 00000100:00100000:0.0:1790772117.582149:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790772117.582158:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:11649:x1877760428529536:12345-0@lo:104: 00010000:00010000:3.0:1790772117.582190:0:11649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22697f expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.582207:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.582216:0:11649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22697f expref: 12 pid: 5818 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772117.582225:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e304380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1877760428529792:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772117.582247:0:11649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d43c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790772117.582260:0:11649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a3400/0xdf68d9a7d6a8ff7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff77 expref: 18 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.582266:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790772117.582270:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f649c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1877760428529024:0@lo:104: 00000100:00100000:0.0:1790772117.582272:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+3:11649:x1877760428529536:12345-0@lo:104: Request processed in 116us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772117.582279:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1790772117.582280:0:11649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b8a00/0xdf68d9a7d6a8ff70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff69 expref: 17 pid: 5816 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772117.582287:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1877760428529152:0@lo:104: 00000100:00100000:3.0:1790772117.582292:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e307100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1877760428529536:0@lo:104: 00010000:00010000:1.0:1790772117.582339:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772117.582347:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772117.582354:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3c00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772117.582359:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772117.582367:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772117.582374:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772117.582380:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790772117.582412:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772117.582419:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772117.582445:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772117.582462:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df2414a3c00/0xdf68d9a7d6a8ff5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a8ff62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772117.582488:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772117.582490:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772117.582492:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772117.582498:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772117.582508:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428529920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772117.582539:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772117.582852:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428529920 00000100:00100000:0.0:1790772117.582872:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428529920 00010000:00010000:0.0:1790772117.582892:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a8ff62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff5b expref: 17 pid: 5818 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772117.583045:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790772117.583054:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246095050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:3293:x1877760428529920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772117.583065:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772117.583070:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a8ff62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff5b expref: 17 pid: 5818 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.583080:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a8ff62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff5b expref: 17 pid: 5818 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.583105:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a8ff62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a8ff5b expref: 17 pid: 5818 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.583116:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772117.583158:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246095050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3293:x1877760428529920:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772117.583166:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790772117.583251:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428529920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772117.587417:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e304e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1877760428529664:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772117.587431:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e304380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11649:1877760428529792:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772117.587479:0:11649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772117.588998:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772117.589069:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412767616 00000100:00100000:0.0:1790772117.589077:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412767616 00010000:00010000:0.0:1790772117.589111:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226986 expref: 13 pid: 5818 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772117.589146:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:0.0:1790772117.589155:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412767616:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772117.589169:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772117.589174:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226986 expref: 13 pid: 5818 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.589185:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226986 expref: 13 pid: 5818 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.589214:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b9e00/0xdf68d9a7d6a8ff54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226986 expref: 13 pid: 5818 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772117.589228:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772117.589284:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:2348:x1877760412767616:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 130us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772117.589291:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:0.0:1790772117.590617:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772117.590782:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412767744 00000100:00100000:3.0:1790772117.590789:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412767744 00010000:00010000:3.0:1790772117.590816:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22697f expref: 12 pid: 5818 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772117.590880:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:3.0:1790772117.590889:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:2347:x1877760412767744:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772117.590901:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772117.590906:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22697f expref: 12 pid: 5818 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.590917:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22697f expref: 12 pid: 5818 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.590932:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b9800/0xdf68d9a7d6a8ff4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22697f expref: 12 pid: 5818 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.590945:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.590996:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.591012:0:7617:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.591019:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.591026:0:7617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.591033:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.591050:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2e00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772117.591054:0:7617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.591063:0:7617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.591086:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772117.591097:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772117.591142:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:2347:x1877760412767744:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 254us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772117.591150:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00010000:00010000:2.0:1790772117.591227:0:11649:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772117.591236:0:11649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772117.591253:0:11649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a2e00/0xdf68d9a7d6a900b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772118.559738:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790772118.687761:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772118.687768:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df273e99800 from 7 10000000:01000000:0.0:1790772118.687773:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772118.687816:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772118.687839:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772118.687850:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772118.687883:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772118.687953:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772118.688195:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27af24900 going to sleep for 11 seconds 00000100:00100000:2.0:1790772118.688389:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428530048 00000100:00100000:2.0:1790772118.688397:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428530048 00000100:00100000:2.0:1790772118.688448:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1790772118.688456:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:5820:x1877760428530048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772118.688469:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772118.688494:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9ab000/0xdf68d9a7d6a900c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a900b9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.688517:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9ab000/0xdf68d9a7d6a900c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a900b9 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.688535:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9ab000/0xdf68d9a7d6a900c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a900b9 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.688544:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab000, rc 0) 00000100:00100000:2.0:1790772118.688624:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428530048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772118.688630:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1790772118.688776:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772118.688790:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772118.688799:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772118.688880:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772118.688925:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772118.688954:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f78240 going to sleep for 11 seconds 00000100:00100000:2.0:1790772118.691711:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428530176 00000100:00100000:2.0:1790772118.691725:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428530176 00000100:00100000:2.0:1790772118.691791:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1790772118.691801:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428530176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772118.692730:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428530176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 928us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772118.692749:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1790772118.695277:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772118.695345:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772118.695420:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772118.695469:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27af243c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772118.698382:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428530304 00000100:00100000:2.0:1790772118.698394:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428530304 00000100:00100000:2.0:1790772118.698519:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790772118.698529:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428530304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772118.698818:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428530304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (3397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772118.698826:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1790772118.698927:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273fe1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772118.704117:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243199880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11662:1877760428530432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772118.704204:0:11662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772118.704248:0:11662:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27ac756c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772118.704375:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428530432 00000100:00100000:0.0:1790772118.704383:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428530432 00000100:00100000:0.0:1790772118.704428:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1790772118.704437:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:11662:x1877760428530432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772118.704690:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:11662:x1877760428530432:12345-0@lo:502:llog_process_th.0 Request processed in 252us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772118.704708:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1790772118.704890:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243199880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11662:1877760428530432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772118.704920:0:11662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772118.704930:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772118.704932:0:11662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790772118.704939:0:11662:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df273e99800 00000020:00000080:3.0:1790772118.704942:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790772118.705010:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e304e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11662:1877760428530560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772118.705046:0:11662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772118.705066:0:11662:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1790772118.705762:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428530560 00000100:00100000:2.0:1790772118.705770:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428530560 00000100:00100000:2.0:1790772118.705805:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790772118.705813:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:11662:x1877760428530560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772118.706008:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:11662:x1877760428530560:12345-0@lo:502:llog_process_th.0 Request processed in 195us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772118.706015:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790772118.706078:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e304e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11662:1877760428530560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772118.706115:0:11662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772118.706121:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772118.706123:0:11662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790772118.706129:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790772118.708202:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790772118.708233:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772118.708245:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772118.708260:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772118.708272:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790772118.708275:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df242cf1800 from 7 10000000:01000000:1.0:1790772118.708278:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772118.708323:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772118.708332:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772118.708341:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772118.708364:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772118.708422:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772118.708460:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772118.708744:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428530688 00000100:00100000:2.0:1790772118.708751:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428530688 00000100:00100000:2.0:1790772118.708788:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790772118.708803:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:5820:x1877760428530688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772118.708816:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772118.708828:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9ab400/0xdf68d9a7d6a900ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a900c7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.708848:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9ab400/0xdf68d9a7d6a900ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a900c7 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.708875:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9ab400/0xdf68d9a7d6a900ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a900c7 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.708884:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab400, rc 0) 00000100:00100000:2.0:1790772118.708924:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428530688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772118.708930:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1790772118.709204:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772118.709219:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772118.709227:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772118.709289:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772118.709317:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772118.709350:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772118.710758:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428530816 00000100:00100000:2.0:1790772118.710769:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428530816 00000100:00100000:2.0:1790772118.710821:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1790772118.710830:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df242cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428530816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772118.711138:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df242cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428530816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (1819us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772118.711150:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1790772118.711248:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772118.711298:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772118.711346:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772118.711377:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772118.712304:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428530944 00000100:00100000:2.0:1790772118.712316:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428530944 00000100:00100000:2.0:1790772118.712363:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1790772118.712371:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428530944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772118.712597:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428530944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772118.712612:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790772118.712754:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428530944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772118.713228:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11663:1877760428531072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772118.713276:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772118.713306:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772118.713528:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428531072 00000100:00100000:2.0:1790772118.713534:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428531072 00000100:00100000:2.0:1790772118.713607:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1790772118.713615:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:11663:x1877760428531072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772118.713927:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:11663:x1877760428531072:12345-0@lo:502:llog_process_th.0 Request processed in 311us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772118.713934:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790772118.714010:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11663:1877760428531072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790772118.714037:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772118.714046:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772118.714049:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790772118.714054:0:11663:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df242cf1800 00000020:00000080:1.0:1790772118.714061:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790772118.714134:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11663:1877760428531200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772118.714185:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772118.714217:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142f783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772118.717012:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428531200 00000100:00100000:2.0:1790772118.717029:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428531200 00000100:00100000:2.0:1790772118.717083:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1790772118.717093:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:11663:x1877760428531200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772118.717366:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:11663:x1877760428531200:12345-0@lo:502:llog_process_th.0 Request processed in 274us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772118.717377:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790772118.717456:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11663:1877760428531200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790772118.717484:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772118.717491:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772118.717493:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790772118.717497:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790772118.718171:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1790772118.718436:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790772118.718447:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.718459:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772118.720448:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790772118.720455:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df258965000 from 7 10000000:01000000:2.0:1790772118.720460:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790772118.720502:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.720521:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.720538:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772118.720583:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df24319b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428531328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772118.720657:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772118.720704:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27ac75900 going to sleep for 11 seconds 00000100:00100000:2.0:1790772118.720734:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428531328 00000100:00100000:2.0:1790772118.720740:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428531328 00000100:00100000:2.0:1790772118.720789:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790772118.720801:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:5820:x1877760428531328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772118.720816:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772118.720828:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a900dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a900d5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.721325:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a900dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a900d5 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.721337:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a900dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a900d5 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772118.721346:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa600, rc 0) 00000100:00100000:2.0:1790772118.721491:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428531328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 694us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772118.721498:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790772118.721885:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df24319b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428531328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772118.721902:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772118.721922:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772118.721992:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428531456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772118.722022:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772118.722044:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4540 going to sleep for 11 seconds 00000100:00100000:3.0:1790772118.722057:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428531456 00000100:00100000:3.0:1790772118.722061:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428531456 00000100:00100000:3.0:1790772118.722089:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790772118.722097:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428531456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772118.722334:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428531456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772118.722341:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790772118.722375:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428531456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772118.722416:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428531584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772118.722464:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772118.722483:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4540 going to sleep for 11 seconds 00000100:00100000:3.0:1790772118.722495:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428531584 00000100:00100000:3.0:1790772118.722498:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428531584 00000100:00100000:3.0:1790772118.722520:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790772118.722526:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428531584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772118.727944:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:5820:x1877760428531584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5409us (5470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772118.727958:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790772118.729997:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f9eb452-8c57-4388-9743-b6ab49eaf81d:5820:1877760428531584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772118.735717:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11665:1877760428531712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772118.735791:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772118.735887:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772118.735926:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428531712 00000100:00100000:1.0:1790772118.735934:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428531712 00000100:00100000:1.0:1790772118.736010:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790772118.736020:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:11665:x1877760428531712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772118.736364:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:11665:x1877760428531712:12345-0@lo:502:llog_process_th.0 Request processed in 345us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772118.736372:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790772118.736447:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11665:1877760428531712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772118.736480:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772118.736489:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772118.736491:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790772118.736498:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df258965000 00000020:00000080:2.0:1790772118.736501:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790772118.736801:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df24319b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11665:1877760428531840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772118.736840:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772118.736883:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27ac75480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772118.736928:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428531840 00000100:00100000:1.0:1790772118.736933:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428531840 00000100:00100000:1.0:1790772118.737008:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790772118.737015:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:11665:x1877760428531840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772118.737162:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:11665:x1877760428531840:12345-0@lo:502:llog_process_th.0 Request processed in 147us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772118.737169:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790772118.737473:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df24319b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f9eb452-8c57-4388-9743-b6ab49eaf81d:11665:1877760428531840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790772118.737495:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772118.737501:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772118.737503:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790772118.737508:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790772118.738222:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790772118.738245:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772118.738255:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772118.738266:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772118.740797:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790772119.272430:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772119.272518:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412767872 00000100:00100000:1.0:1790772119.272527:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412767872 00000100:00100000:1.0:1790772119.272598:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 264 00000100:00100000:1.0:1790772119.272608:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:5589:x1877760412767872:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772119.272623:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772119.272639:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a900e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269d3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772119.272663:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a900e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269d3 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772119.272674:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a900e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269d3 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772119.272682:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8e00, rc 0) 00000100:00100000:1.0:1790772119.272756:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412767872:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 149us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772119.272762:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 264 00000100:00100000:3.0:1790772119.279292:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772119.279427:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412768000 00000100:00100000:1.0:1790772119.279437:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412768000 00000100:00100000:1.0:1790772119.279489:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 265 00000100:00100000:1.0:1790772119.279499:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412768000:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772119.279789:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412768000:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 291us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772119.279796:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 265 00000100:00100000:3.0:1790772119.286754:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772119.286914:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412768128 00000100:00100000:2.0:1790772119.286923:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412768128 00000100:00100000:2.0:1790772119.286973:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 266 00000100:00100000:2.0:1790772119.286982:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412768128:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790772119.287267:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412768128:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 284us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772119.287275:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 266 00000100:00100000:3.0:1790772119.293481:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772119.294178:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412768256 00000100:00100000:2.0:1790772119.294188:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412768256 00000100:00100000:2.0:1790772119.294245:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 267 00000100:00100000:2.0:1790772119.294254:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:9952:x1877760412768256:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772119.294485:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:9952:x1877760412768256:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 231us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772119.294493:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 267 00000100:00100000:3.0:1790772119.313031:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772119.314193:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412768384 00000100:00100000:1.0:1790772119.314206:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412768384 00000100:00100000:1.0:1790772119.314269:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 268 00000100:00100000:1.0:1790772119.314279:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:9952:x1877760412768384:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790772119.314517:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:9952:x1877760412768384:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 238us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772119.314525:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 268 00000100:00100000:3.0:1790772119.323122:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772119.324956:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412768512 00000100:00100000:2.0:1790772119.324969:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412768512 00000100:00100000:2.0:1790772119.325030:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 269 00000100:00100000:2.0:1790772119.325040:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:5589:x1877760412768512:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772119.325068:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772119.325085:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9aa000/0xdf68d9a7d6a900ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269da expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772119.325112:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9aa000/0xdf68d9a7d6a900ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269da expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772119.325122:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9aa000/0xdf68d9a7d6a900ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269da expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772119.325141:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa000, rc 0) 00000100:00100000:2.0:1790772119.325203:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:5589:x1877760412768512:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 163us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772119.325211:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 269 00000100:00100000:0.0:1790772119.331132:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772119.331231:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412768640 00000100:00100000:2.0:1790772119.331241:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412768640 00000100:00100000:2.0:1790772119.331306:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 270 00000100:00100000:2.0:1790772119.331316:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:5589:x1877760412768640:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772119.331612:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:5589:x1877760412768640:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 296us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772119.331621:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 270 00000100:00100000:3.0:1790772119.336103:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772119.337058:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412768768 00000100:00100000:1.0:1790772119.337070:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412768768 00000100:00100000:1.0:1790772119.337151:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 271 00000100:00100000:1.0:1790772119.337162:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:5589:x1877760412768768:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772119.337396:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:5589:x1877760412768768:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 235us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772119.337405:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 271 00000100:00100000:0.0:1790772119.350239:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772119.350799:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412768896 00000100:00100000:1.0:1790772119.350820:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412768896 00000100:00100000:1.0:1790772119.350884:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 272 00000100:00100000:1.0:1790772119.350895:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:9955:x1877760412768896:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790772119.351148:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:9955:x1877760412768896:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 248us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772119.351157:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 272 00000100:00100000:0.0:1790772119.361698:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772119.361782:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412769024 00000100:00100000:2.0:1790772119.361791:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412769024 00000100:00100000:2.0:1790772119.361835:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 273 00000100:00100000:2.0:1790772119.361845:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:9955:x1877760412769024:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772119.362088:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:9955:x1877760412769024:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 243us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772119.362103:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 273 00010000:00010000:1.0:1790772119.583968:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772119.776467:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790772120.609758:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772121.631974:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772122.079915:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428532096:0@lo:400:kworker.0 00000100:00100000:2.0:1790772122.079988:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772122.080050:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428532608:0@lo:400:kworker.0 00000100:00100000:2.0:1790772122.080145:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772122.080176:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790772122.080182:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428531968:0@lo:400:kworker.0 00000100:00100000:2.0:1790772122.080213:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772122.080233:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428532480:0@lo:400:kworker.0 00000100:00100000:2.0:1790772122.080269:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772122.080403:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428532096 00000100:00100000:1.0:1790772122.080411:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428532096 00000100:00100000:1.0:1790772122.080462:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428532480 00000100:00100000:1.0:1790772122.080465:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428532480 00000100:00100000:1.0:1790772122.080492:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790772122.080501:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24319b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428532096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772122.080581:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24319b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428532096:12345-0@lo:400:kworker.0 Request processed in 81us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772122.080589:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790772122.080605:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790772122.080612:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428532480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772122.080639:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428532480:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772122.080645:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790772122.080901:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428532224:0@lo:400:kworker.0 00000100:00100000:3.0:1790772122.080931:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772122.080958:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772122.080964:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428532352:0@lo:400:kworker.0 00000100:00100000:3.0:1790772122.080986:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772122.081015:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428532608 00000100:00100000:3.0:1790772122.081019:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428532608 00000100:00100000:3.0:1790772122.081043:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428532352 00000100:00100000:3.0:1790772122.081045:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428532352 00000100:00100000:3.0:1790772122.081062:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790772122.081069:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24319b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428532608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772122.081099:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24319b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428532608:12345-0@lo:400:kworker.0 Request processed in 31us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772122.081134:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790772122.081149:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790772122.081154:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428532352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772122.081189:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428532352:12345-0@lo:400:kworker.0 Request processed in 35us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772122.081195:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790772122.081210:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428532224 00000100:00100000:3.0:1790772122.081213:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428532224 00000100:00100000:3.0:1790772122.081237:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790772122.081255:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428532224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772122.081284:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428532224:12345-0@lo:400:kworker.0 Request processed in 41us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772122.081290:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1790772122.081305:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772122.081308:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772122.081310:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790772122.081341:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f377800 x1877760428532352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772122.081354:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428532352:0@lo:400:kworker.0 00000100:00100000:3.0:1790772122.081365:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428532224:0@lo:400:kworker.0 00000100:00100000:3.0:1790772122.081387:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428531968 00000100:00100000:3.0:1790772122.081390:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428531968 00000100:00100000:3.0:1790772122.081413:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790772122.081535:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2591a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428531968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772122.081593:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2591a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428531968:12345-0@lo:400:kworker.0 Request processed in 61us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772122.081607:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1790772122.082227:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428531968:0@lo:400:kworker.0 00000100:00100000:2.0:1790772122.082241:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428532480:0@lo:400:kworker.0 00000100:00100000:2.0:1790772122.082264:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428532096:0@lo:400:kworker.0 00000100:00100000:2.0:1790772122.082275:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428532608:0@lo:400:kworker.0 00000100:00100000:2.0:1790772122.083810:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772122.083825:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428532736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772122.083887:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772122.083925:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428532736 00000100:00100000:2.0:1790772122.083931:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428532736 00000100:00100000:2.0:1790772122.083982:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790772122.083990:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428532736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772122.084021:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772122.084062:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428532736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772122.084079:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1790772122.084127:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df243199500 x1877760428532736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772122.084145:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428532736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772122.153223:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772122.153259:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772122.153350:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772122.153426:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772122.153471:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412769152 00000100:00100000:1.0:1790772122.153480:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412769152 00000100:00100000:1.0:1790772122.153528:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 275 00000100:00100000:1.0:1790772122.153538:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412769152:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772122.153614:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412769152:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 78us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772122.153632:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 275 00000100:00100000:3.0:1790772122.156072:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412769408 00000100:00100000:3.0:1790772122.156083:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412769408 00000100:00100000:3.0:1790772122.156164:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:3.0:1790772122.156173:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2350:x1877760412769408:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772122.156353:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2350:x1877760412769408:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 71us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772122.156363:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00080000:1.0:1790772122.156373:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772122.158314:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412769280 00000100:00100000:2.0:1790772122.158326:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412769280 00000100:00080000:1.0:1790772122.158403:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772122.159716:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412769536 00000100:00100000:2.0:1790772122.159726:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412769536 00000100:00080000:0.0:1790772122.159873:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772122.159956:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:1.0:1790772122.159975:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2350:x1877760412769280:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772122.160057:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2350:x1877760412769280:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 91us (6705us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772122.160065:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:1.0:1790772122.160095:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 110 00000100:00100000:1.0:1790772122.160103:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412769536:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772122.160130:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412769536:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 29us (6703us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772122.160136:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 110 00000100:00100000:0.0:1790772122.591793:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428532864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772122.591871:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772122.592039:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428532864 00000100:00100000:2.0:1790772122.592047:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428532864 00000100:00100000:2.0:1790772122.592091:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790772122.592101:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428532864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772122.592133:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772122.592185:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428532864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772122.592192:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790772122.592359:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428532864:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790772122.655728:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772123.679808:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772124.703729:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772125.728535:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772126.751683:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772127.199789:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772127.199821:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428532992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772127.199886:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772127.200459:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428532992 00000100:00100000:2.0:1790772127.200468:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428532992 00000100:00100000:2.0:1790772127.200536:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790772127.200546:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428532992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772127.200598:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772127.200653:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428532992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772127.200660:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1790772127.200719:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790772127.201166:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df243198e00 x1877760428532992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772127.201187:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428532992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772127.202125:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428533120:0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202179:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772127.202214:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428533632:0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202241:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772127.202263:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772127.202268:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428533504:0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202290:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772127.202317:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428533120 00000100:00100000:3.0:1790772127.202323:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428533120 00000100:00100000:3.0:1790772127.202359:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1790772127.202367:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428533120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202407:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428533120:12345-0@lo:400:kworker.0 Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772127.202413:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1790772127.202451:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428533632 00000100:00100000:3.0:1790772127.202454:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428533632 00000100:00100000:3.0:1790772127.202480:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790772127.202485:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428533632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202514:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428533632:12345-0@lo:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772127.202520:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790772127.202534:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428533504 00000100:00100000:3.0:1790772127.202537:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428533504 00000100:00100000:3.0:1790772127.202587:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790772127.202594:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428533504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202621:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428533504:12345-0@lo:400:kworker.0 Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772127.202626:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790772127.202655:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428533504:0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202663:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428533120:0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202671:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428533632:0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202703:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428533248:0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202727:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772127.202746:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772127.202752:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428533376:0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202772:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772127.202793:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428533248 00000100:00100000:3.0:1790772127.202796:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428533248 00000100:00100000:3.0:1790772127.202826:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428533376 00000100:00100000:3.0:1790772127.202830:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428533376 00000100:00100000:3.0:1790772127.202855:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790772127.202860:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428533248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202893:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428533248:12345-0@lo:400:kworker.0 Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772127.202900:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790772127.202925:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790772127.202931:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428533376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202957:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428533376:12345-0@lo:400:kworker.0 Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772127.202962:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790772127.202987:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428533376:0@lo:400:kworker.0 00000100:00100000:3.0:1790772127.202995:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428533248:0@lo:400:kworker.0 00000100:00080000:0.0:1790772127.204137:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772127.204144:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772127.276010:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772127.276060:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772127.276092:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772127.276243:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772127.276285:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412769920 00000100:00100000:0.0:1790772127.276295:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412769920 00000100:00100000:0.0:1790772127.276353:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:0.0:1790772127.276362:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2350:x1877760412769920:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772127.276426:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2350:x1877760412769920:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772127.276433:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00080000:0.0:1790772127.276543:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772127.279724:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412769664 00000100:00100000:1.0:1790772127.279739:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412769664 00000100:00100000:1.0:1790772127.279816:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 277 00000100:00100000:1.0:1790772127.279827:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412769664:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772127.279900:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412769664:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 75us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772127.279922:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 277 00000100:00100000:2.0:1790772127.282417:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412769792 00000100:00100000:2.0:1790772127.282432:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412769792 00000100:00100000:2.0:1790772127.282607:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412770048 00000100:00100000:2.0:1790772127.282611:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412770048 00000100:00100000:1.0:1790772127.282671:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:1.0:1790772127.282683:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2349:x1877760412769792:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772127.282759:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2349:x1877760412769792:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 78us (6697us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772127.282766:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00080000:0.0:1790772127.283456:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772127.283594:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 115 00000100:00100000:2.0:1790772127.283604:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412770048:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772127.283669:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412770048:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 67us (7576us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772127.283676:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 115 00000100:00100000:1.0:1790772127.712265:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772127.712298:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428533760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772127.712363:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772127.712535:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428533760 00000100:00100000:2.0:1790772127.712542:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428533760 00000100:00100000:2.0:1790772127.712611:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772127.712632:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428533760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772127.712667:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772127.712714:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428533760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772127.712721:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772127.712763:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428533760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772127.775913:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772128.799695:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772129.824006:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790772130.016374:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790772130.847786:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772131.874478:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772132.320423:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772132.320444:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428533888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772132.320507:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772132.320576:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428533888 00000100:00100000:1.0:1790772132.320584:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428533888 00000100:00100000:1.0:1790772132.320642:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790772132.320653:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428533888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772132.320685:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772132.320725:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428533888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772132.320731:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1790772132.321006:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772132.321102:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428534016:0@lo:400:kworker.0 00000100:00100000:0.0:1790772132.321137:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772132.321322:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428534144:0@lo:400:kworker.0 00000100:00100000:2.0:1790772132.321351:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772132.321382:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428534016 00000100:00100000:2.0:1790772132.321386:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428534016 00000100:00100000:2.0:1790772132.321410:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1790772132.321417:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428534016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772132.321448:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428534016:12345-0@lo:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772132.321461:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790772132.321661:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428534016:0@lo:400:kworker.0 00000100:00100000:0.0:1790772132.321669:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27af06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428534528:0@lo:400:kworker.0 00000100:00100000:0.0:1790772132.321693:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772132.321734:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428534528 00000100:00100000:0.0:1790772132.321737:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428534528 00000100:00100000:0.0:1790772132.321769:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790772132.321775:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428534528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772132.321821:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428534528:12345-0@lo:400:kworker.0 Request processed in 46us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772132.321827:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1790772132.321845:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772132.321864:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27af06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428534528:0@lo:400:kworker.0 00010000:00080000:2.0:1790772132.322580:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f552680 x1877760428533888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772132.322601:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428533888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772132.322622:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428534272:0@lo:400:kworker.0 00000100:00100000:2.0:1790772132.322651:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772132.322677:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772132.322683:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27af05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428534400:0@lo:400:kworker.0 00000100:00100000:2.0:1790772132.322703:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772132.322730:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428534144 00000100:00100000:2.0:1790772132.322735:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428534144 00000100:00100000:2.0:1790772132.322760:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428534272 00000100:00100000:2.0:1790772132.322763:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428534272 00000100:00100000:2.0:1790772132.322779:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428534400 00000100:00100000:2.0:1790772132.322816:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428534400 00000100:00100000:2.0:1790772132.322834:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790772132.322840:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428534144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772132.322877:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428534144:12345-0@lo:400:kworker.0 Request processed in 37us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772132.322882:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790772132.322895:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790772132.322901:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428534272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772132.322931:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428534272:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772132.322936:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790772132.322957:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790772132.322963:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428534400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772132.322994:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428534400:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772132.323000:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790772132.323024:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27af05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428534400:0@lo:400:kworker.0 00000100:00100000:2.0:1790772132.323033:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428534272:0@lo:400:kworker.0 00000100:00080000:0.0:1790772132.323107:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772132.323146:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428534144:0@lo:400:kworker.0 00000100:00100000:1.0:1790772132.391167:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772132.391227:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772132.391410:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412770176 00000100:00100000:0.0:1790772132.391420:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412770176 00000100:00100000:0.0:1790772132.391486:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 279 00000100:00100000:0.0:1790772132.391496:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2349:x1877760412770176:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772132.391592:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2349:x1877760412770176:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 97us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772132.391600:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 279 00000100:00100000:2.0:1790772132.391778:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412770304 00000100:00100000:2.0:1790772132.391792:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412770304 00000100:00100000:2.0:1790772132.391845:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00100000:2.0:1790772132.391853:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2349:x1877760412770304:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772132.391886:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2349:x1877760412770304:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 34us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772132.391892:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00080000:0.0:1790772132.392430:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772132.409475:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772132.409620:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412770432 00000100:00100000:0.0:1790772132.409630:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412770432 00000100:00100000:0.0:1790772132.409710:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:0.0:1790772132.409719:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2346:x1877760412770432:12345-192.168.206.27@tcp:9:kworker.0 00000100:00080000:2.0:1790772132.409937:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1790772132.409970:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a90026 00000100:00080000:0.0:1790772132.409979:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8df259050800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790772132.410025:0:6679:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1790772132.410263:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772132.410402:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+2:2346:x1877760412770432:12345-192.168.206.27@tcp:9:kworker.0 Request processed in 682us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772132.410411:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:1.0:1790772132.419246:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772132.419338:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412770560 00000100:00100000:2.0:1790772132.419347:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412770560 00000100:00100000:2.0:1790772132.419434:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00100000:2.0:1790772132.419444:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412770560:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772132.419531:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412770560:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772132.419539:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00080000:0.0:1790772132.420289:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772132.832338:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428534656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772132.832403:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772132.832873:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428534656 00000100:00100000:1.0:1790772132.832882:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428534656 00000100:00100000:1.0:1790772132.832945:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790772132.832955:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428534656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772132.832990:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772132.833090:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428534656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772132.833097:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790772132.833255:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428534656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772132.898045:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772133.920152:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772134.944320:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772135.967833:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772136.991853:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772137.439848:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428534784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772137.439945:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772137.440117:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428534784 00000100:00100000:1.0:1790772137.440125:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428534784 00000100:00100000:1.0:1790772137.440187:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790772137.440197:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428534784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772137.440230:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772137.440281:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428534784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772137.440288:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1790772137.440317:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f552d80 x1877760428534784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772137.440339:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428534784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790772137.440356:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772137.440915:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428535168:0@lo:400:kworker.0 00000100:00100000:2.0:1790772137.440915:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428535296:0@lo:400:kworker.0 00000100:00100000:1.0:1790772137.441061:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428534912:0@lo:400:kworker.0 00000100:00100000:3.0:1790772137.441099:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772137.441125:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772137.441132:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428535040:0@lo:400:kworker.0 00000100:00100000:3.0:1790772137.441155:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772137.441182:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428535168 00000100:00100000:3.0:1790772137.441187:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428535168 00000100:00100000:3.0:1790772137.441223:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428535040 00000100:00100000:3.0:1790772137.441227:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428535040 00000100:00100000:3.0:1790772137.441244:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790772137.441251:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428535168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772137.441289:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428535168:12345-0@lo:400:kworker.0 Request processed in 38us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772137.441302:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790772137.441317:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790772137.441322:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428535040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772137.441350:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428535040:12345-0@lo:400:kworker.0 Request processed in 27us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772137.441356:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1790772137.441378:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772137.441648:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428535040:0@lo:400:kworker.0 00000100:00100000:3.0:1790772137.441658:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428535168:0@lo:400:kworker.0 00000100:00100000:2.0:1790772137.447150:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772137.451171:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428535296 00000100:00100000:3.0:1790772137.451185:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428535296 00000100:00100000:3.0:1790772137.451243:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790772137.451251:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428535296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772137.451337:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428535296:12345-0@lo:400:kworker.0 Request processed in 86us (4316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772137.451345:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1790772137.451368:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772137.451834:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428535296:0@lo:400:kworker.0 00000100:00100000:1.0:1790772137.455896:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772137.455949:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428535424:0@lo:400:kworker.0 00000100:00100000:1.0:1790772137.455983:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772137.456159:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428535424 00000100:00100000:3.0:1790772137.456168:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428535424 00000100:00100000:3.0:1790772137.456228:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790772137.456238:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428535424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772137.456292:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428535424:12345-0@lo:400:kworker.0 Request processed in 56us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772137.456298:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790772137.456841:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428534912 00000100:00100000:2.0:1790772137.456847:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428534912 00000100:00100000:2.0:1790772137.456881:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1790772137.456889:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428534912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772137.456930:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428534912:12345-0@lo:400:kworker.0 Request processed in 42us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772137.456936:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:1.0:1790772137.459236:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772137.459288:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428534912:0@lo:400:kworker.0 00000100:00100000:1.0:1790772137.459307:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428535424:0@lo:400:kworker.0 00000100:00100000:1.0:1790772137.517924:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772137.517959:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772137.518041:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000001:00100000:1.0:1790772137.519202:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:1.0:1790772137.519208:0:7629:0:(genops.c:885:class_export_put()) final put ffff8df259053800/9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:2.0:1790772137.519236:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df259053800/9271f5fd-fa87-4f6b-a8bf-0936e195e8be for lustre-OST0001 00000020:00000080:2.0:1790772137.519283:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df259050800 for lustre-OST0001 00000100:00100000:3.0:1790772137.519407:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412770688 00000100:00100000:3.0:1790772137.519425:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412770688 00000100:00100000:3.0:1790772137.519476:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 281 00000100:00100000:3.0:1790772137.519486:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2347:x1877760412770688:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772137.519627:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2347:x1877760412770688:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 142us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772137.519634:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 281 00000100:00100000:3.0:1790772137.519666:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412770944 00000100:00100000:3.0:1790772137.519670:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412770944 00000100:00100000:3.0:1790772137.519709:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412770816 00000100:00100000:3.0:1790772137.519713:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412770816 00000100:00100000:3.0:1790772137.519731:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 124 00000100:00100000:3.0:1790772137.519737:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412770944:12345-192.168.206.27@tcp:400:kworker.0 00000100:00080000:2.0:1790772137.520006:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772137.522138:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412770944:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 2392us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772137.522151:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 124 00000100:00100000:3.0:1790772137.522187:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 125 00000100:00100000:3.0:1790772137.522199:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412770816:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772137.522242:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412770816:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 48us (4200us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772137.522248:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 125 00000100:00100000:0.0:1790772137.951779:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772137.951801:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27af07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428535552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772137.951874:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772137.952205:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428535552 00000100:00100000:1.0:1790772137.952212:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428535552 00000100:00100000:1.0:1790772137.952262:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790772137.952271:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428535552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772137.952313:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772137.952366:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428535552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772137.952374:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790772137.952681:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27af07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428535552:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772138.015818:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772139.043781:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772140.065233:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772140.257896:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790772141.088113:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790772142.087085:0:11829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:42:19 (1790772139) 00010000:00010000:2.0:1790772142.119712:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772142.559955:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428535680:0@lo:400:kworker.0 00000100:00100000:0.0:1790772142.560097:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772142.560283:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428535680 00000100:00100000:2.0:1790772142.560296:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428535680 00000100:00100000:2.0:1790772142.560369:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1790772142.560382:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428535680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772142.560944:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428536064:0@lo:400:kworker.0 00000100:00100000:1.0:1790772142.560985:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772142.561028:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428535936:0@lo:400:kworker.0 00000100:00100000:1.0:1790772142.561057:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772142.561077:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772142.561083:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428535808:0@lo:400:kworker.0 00000100:00100000:1.0:1790772142.561107:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772142.563912:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428535680:12345-0@lo:400:kworker.0 Request processed in 3517us (3799us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772142.563952:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1790772142.564029:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428536064 00000100:00100000:3.0:1790772142.564040:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428536064 00000100:00100000:3.0:1790772142.564130:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790772142.564141:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428536064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772142.564243:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428536064:12345-0@lo:400:kworker.0 Request processed in 105us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772142.564251:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790772142.564278:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428535936 00000100:00100000:3.0:1790772142.564282:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428535936 00000100:00100000:3.0:1790772142.564309:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428535808 00000100:00100000:3.0:1790772142.564311:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428535808 00000100:00100000:3.0:1790772142.564721:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790772142.564739:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428535936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772142.564785:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428535936:12345-0@lo:400:kworker.0 Request processed in 56us (3727us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772142.564792:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790772142.564804:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790772142.564811:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428535808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772142.564841:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428535808:12345-0@lo:400:kworker.0 Request processed in 30us (3735us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772142.564847:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790772142.564914:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428535808:0@lo:400:kworker.0 00000100:00100000:3.0:1790772142.564928:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428535936:0@lo:400:kworker.0 00000100:00100000:3.0:1790772142.564954:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772142.564965:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428536320:0@lo:400:kworker.0 00000100:00100000:3.0:1790772142.565022:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772142.565062:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428536320 00000100:00100000:3.0:1790772142.565068:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428536320 00000100:00100000:3.0:1790772142.565397:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790772142.565410:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428536320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772142.565480:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428536320:12345-0@lo:400:kworker.0 Request processed in 72us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772142.565488:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790772142.565525:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428536320:0@lo:400:kworker.0 00000100:00100000:3.0:1790772142.565659:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428536448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772142.565690:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790772142.565872:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772142.565879:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772142.565881:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772142.567295:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428536448 00000100:00100000:1.0:1790772142.567308:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428536448 00000100:00100000:1.0:1790772142.567370:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790772142.567380:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428536448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772142.567424:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772142.567508:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428536448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772142.567525:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1790772142.567534:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2745aad80 x1877760428536448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772142.567586:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428536448:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790772142.567588:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2745a8380 x1877760428536064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790772158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772142.567597:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428536064:0@lo:400:kworker.0 00000100:00100000:1.0:1790772142.567607:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772142.567619:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428536192:0@lo:400:kworker.0 00000100:00100000:1.0:1790772142.567656:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772142.567893:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428536192 00000100:00100000:2.0:1790772142.567898:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428536192 00000100:00100000:2.0:1790772142.567956:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790772142.568628:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428536192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772142.568704:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428536192:12345-0@lo:400:kworker.0 Request processed in 83us (1045us total) trans 0 rc 0/0 00000100:00080000:3.0:1790772142.568822:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772142.568876:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428536192:0@lo:400:kworker.0 00000100:00100000:0.0:1790772142.569277:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428535680:0@lo:400:kworker.0 00000100:00100000:2.0:1790772142.571842:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790772142.644474:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772142.644524:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772142.644632:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772142.644755:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412771328 00000100:00100000:0.0:1790772142.644755:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412771200 00000100:00100000:2.0:1790772142.644769:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412771328 00000100:00100000:0.0:1790772142.644769:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412771200 00000100:00100000:3.0:1790772142.644834:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412771072 00000100:00100000:3.0:1790772142.644839:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412771072 00000100:00100000:2.0:1790772142.644851:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 129 00000100:00100000:3.0:1790772142.644868:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 283 00000100:00100000:3.0:1790772142.644880:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412771072:12345-192.168.206.27@tcp:400:kworker.0 00000100:00080000:1.0:1790772142.644897:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772142.644975:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412771072:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 96us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772142.644983:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 283 00000100:00100000:0.0:1790772142.646276:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 130 00000100:00100000:0.0:1790772142.646290:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412771200:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772142.646390:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412771200:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 104us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772142.646399:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 130 00000100:00100000:2.0:1790772142.649152:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412771328:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772142.649638:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412771328:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 4776us (5110us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772142.649652:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 129 00000100:00100000:1.0:1790772143.074639:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772143.074671:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27af06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428536576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772143.074789:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772143.075169:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428536576 00000100:00100000:0.0:1790772143.075180:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428536576 00000100:00100000:0.0:1790772143.075251:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790772143.075262:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428536576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790772143.075310:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772143.075507:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428536576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 247us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772143.075516:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790772143.075870:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27af06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428536576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772143.136044:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772143.770884:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772143.771150:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412771456 00000100:00100000:3.0:1790772143.771163:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412771456 00000100:00100000:3.0:1790772143.771245:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:3.0:1790772143.771257:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:10224:x1877760412771456:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772143.771288:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772143.771621:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a900f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269e1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772143.771732:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a900f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772143.771746:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a900f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772143.771761:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a900f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772143.771808:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772143.771812:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772143.771861:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a900f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772143.771886:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a900f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269e1 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772143.771982:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a900f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269e1 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772143.771992:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07500) 00010000:00010000:3.0:1790772143.771995:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772143.771998:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3400, rc 0) 00000100:00100000:3.0:1790772143.772128:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:10224:x1877760412771456:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 871us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772143.772210:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:1.0:1790772143.789306:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772143.789491:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412771584 00000100:00100000:0.0:1790772143.789505:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412771584 00000100:00100000:0.0:1790772143.789695:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:0.0:1790772143.789707:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:10225:x1877760412771584:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772143.789743:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772143.789769:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a900ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269e8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.789852:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90106 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.789869:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.789882:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.789901:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9010d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.789909:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9010d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.789916:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9010d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790204:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90114 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790215:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90114 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790222:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90114 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772143.790268:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790772143.790273:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772143.790300:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90114 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790311:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790318:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90106 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790324:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790331:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772143.790335:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790343:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90106 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790370:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07500) 00010000:00010000:0.0:1790772143.790374:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772143.790379:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790385:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790402:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9010d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790419:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9010d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790425:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9010d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790430:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772143.790433:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9010d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790439:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9010d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790447:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8df254043400) 00010000:00010000:0.0:1790772143.790450:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772143.790453:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9010d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790460:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9010d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790499:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a900ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269e8 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790513:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90114 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269e8 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772143.790521:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df254043600) 00010000:00010000:0.0:1790772143.790523:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772143.790531:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8a00, rc 0) 00000100:00100000:0.0:1790772143.790672:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:10225:x1877760412771584:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 967us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772143.790681:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:1.0:1790772143.799878:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772143.799990:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412771840 00000100:00100000:2.0:1790772143.800004:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412771840 00000100:00100000:2.0:1790772143.801995:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:2.0:1790772143.802031:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:10225:x1877760412771840:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772143.802060:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772143.802093:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9011b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269ef expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.802430:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90122 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.802450:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90122 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.802463:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90122 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.802782:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90129 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.802806:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90129 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.802819:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90129 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803468:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a90130 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803479:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a90130 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803487:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a90130 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772143.803498:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790772143.803664:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90122 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803824:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90122 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803840:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90122 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803846:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772143.803851:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90122 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803859:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90122 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803872:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df254043600) 00010000:00010000:2.0:1790772143.803875:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772143.803879:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90122 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803885:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90122 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803897:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90129 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803903:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90129 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803908:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90129 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803913:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772143.803915:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90129 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803930:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90129 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803937:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df251c57200) 00010000:00010000:2.0:1790772143.803939:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772143.803942:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90129 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.803947:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90129 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.805395:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9011b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269ef expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.805418:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a90130 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269ef expref: 9 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772143.805427:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:2.0:1790772143.805429:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772143.805432:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aaa00, rc 0) 00000100:00100000:2.0:1790772143.805507:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:10225:x1877760412771840:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 3478us (5642us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790772143.805516:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:1.0:1790772143.813010:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772143.813121:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412771968 00000100:00100000:2.0:1790772143.813131:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412771968 00000100:00100000:2.0:1790772143.813251:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:2.0:1790772143.813262:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:10225:x1877760412771968:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790772143.813395:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:10225:x1877760412771968:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 Request processed in 135us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772143.813403:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00010000:00010000:3.0:1790772144.160909:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772144.352280:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790772145.185134:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772145.913816:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772145.915442:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412772096 00000100:00100000:3.0:1790772145.915463:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412772096 00000100:00100000:3.0:1790772145.915608:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:3.0:1790772145.915627:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:10267:x1877760412772096:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772145.915659:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772145.915693:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9013e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269f6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.915806:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90145 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.915825:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90145 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.915842:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90145 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.915858:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9014c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.915865:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9014c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.915871:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9014c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916167:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90145 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916177:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90145 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916197:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90145 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916204:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772145.916210:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90145 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790772145.916373:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790772145.916511:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90145 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916530:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07500) 00010000:00010000:3.0:1790772145.916534:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772145.916544:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916586:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916604:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9014c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916610:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9014c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916619:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9014c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916628:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772145.916631:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9014c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916652:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9014c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916663:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df247e07700) 00010000:00010000:3.0:1790772145.916665:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772145.916668:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9014c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916674:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9014c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916743:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9013e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269f6 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916760:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07500) 00010000:00010000:3.0:1790772145.916767:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772145.916771:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9013e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269f6 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.916781:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2e00, rc 0) 00000100:00100000:3.0:1790772145.916890:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:10267:x1877760412772096:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1271us (3100us total) trans 0 rc 301/301 00000100:00100000:3.0:1790772145.916900:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:1.0:1790772145.923034:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772145.923139:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412772352 00000100:00100000:3.0:1790772145.923151:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412772352 00000100:00100000:3.0:1790772145.923222:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:3.0:1790772145.923233:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:10267:x1877760412772352:12345-192.168.206.27@tcp:36:lfs.0 00010000:00010000:3.0:1790772145.923316:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772145.923351:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a900f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269e1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.923373:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07500) 00010000:00010000:3.0:1790772145.923386:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772145.923692:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90153 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.923720:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90153 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.923733:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90153 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.923748:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.923755:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772145.923762:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772145.928928:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790772145.928958:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90153 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772145.928971:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90153 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772145.928980:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90153 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772145.928987:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772145.928992:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90153 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772145.929001:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90153 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772145.929020:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07700) 00010000:00010000:2.0:1790772145.929024:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772145.929030:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90153 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772145.929036:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90153 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772145.929063:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bac48b38 reply state 00000000417e1c19 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772145.929090:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772145.929263:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:10267:x1877760412772352:12345-192.168.206.27@tcp:36:lfs.0 Request processed in 6026us (6239us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790772145.929273:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00010000:00010000:0.0:1790772145.931702:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772145.931735:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772145.931744:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772145.931751:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772145.931756:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772145.931764:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772145.931783:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df247e07d00) 00010000:00010000:0.0:1790772145.931786:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772145.931790:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772145.931796:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9015a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772146.016516:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772146.017626:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412772480 00000100:00100000:2.0:1790772146.017644:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412772480 00000100:00100000:2.0:1790772146.017736:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:2.0:1790772146.017750:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:10275:x1877760412772480:12345-192.168.206.27@tcp:101:lctl.0 00010000:00010000:2.0:1790772146.017783:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772146.017813:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90161 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f2269fd expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.017900:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90168 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.018275:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.018288:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772146.018334:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772146.018339:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772146.018388:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.018418:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269fd expref: 11 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.018463:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90168 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269fd expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.018473:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57200) 00010000:00010000:2.0:1790772146.018476:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772146.018479:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa200, rc 0) 00000100:00100000:2.0:1790772146.018671:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:10275:x1877760412772480:12345-192.168.206.27@tcp:101:lctl.0 Request processed in 923us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772146.018680:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:2.0:1790772146.105962:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772146.106124:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412772608 00000100:00100000:3.0:1790772146.106137:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412772608 00000100:00100000:3.0:1790772146.106210:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:3.0:1790772146.106222:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:10281:x1877760412772608:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1790772146.106249:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772146.106275:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9016f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a04 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.106376:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90176 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.106393:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.106406:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.106422:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9017d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.106432:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9017d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.106438:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9017d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.111956:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a90184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112004:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a90184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112019:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a90184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772146.112062:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790772146.112067:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772146.112116:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a90184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112132:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112392:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90176 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112402:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112409:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772146.112414:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112423:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90176 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112439:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57200) 00010000:00010000:0.0:1790772146.112442:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772146.112448:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112465:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112484:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9017d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112490:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9017d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112495:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9017d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112500:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772146.112503:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9017d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112509:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9017d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112518:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df247e07500) 00010000:00010000:0.0:1790772146.112521:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772146.112524:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9017d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112530:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9017d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112703:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9016f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a04 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112732:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a90184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a04 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.112747:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772146.112749:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790772146.112752:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9400, rc 0) 00000100:00100000:0.0:1790772146.112854:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:10281:x1877760412772608:12345-192.168.206.27@tcp:101:bash.0 Request processed in 6633us (6905us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772146.112865:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:3.0:1790772146.129784:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772146.129998:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412772864 00000100:00100000:1.0:1790772146.130011:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412772864 00000100:00100000:1.0:1790772146.130108:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:1.0:1790772146.130120:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:10281:x1877760412772864:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1790772146.130245:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772146.130272:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9018b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a0b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.130436:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90192 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.130452:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90192 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.130465:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90192 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.134544:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.134776:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.134789:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790772146.137612:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1790772146.137862:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.137879:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.137890:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.139798:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90192 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.139806:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90192 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.139813:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90192 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.139819:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772146.139823:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90192 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.139831:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90192 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.139845:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:1.0:1790772146.139848:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772146.139853:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90192 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.139859:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90192 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772146.139874:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000570cc7b7 reply state 0000000093be5db3 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772146.139883:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790772146.139925:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9018b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a0b expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.139951:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a0b expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.139959:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001f00) 00010000:00010000:1.0:1790772146.139961:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772146.139964:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9c00, rc 0) 00000100:00100000:1.0:1790772146.140038:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10281:x1877760412772864:12345-192.168.206.27@tcp:101:bash.0 Request processed in 9920us (10275us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790772146.140047:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 40 00010000:00010000:0.0:1790772146.142663:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.142679:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.142686:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.142693:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772146.142697:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.142704:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.142731:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df27c001e00) 00010000:00010000:0.0:1790772146.142734:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772146.142739:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.142744:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90199 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772146.144721:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772146.145530:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412772992 00000100:00100000:0.0:1790772146.145545:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412772992 00000100:00100000:0.0:1790772146.145613:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:0.0:1790772146.145621:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1877760412772992:12345-192.168.206.27@tcp:8:bash.0 00010000:00080000:0.0:1790772146.145651:0:6678:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:0.0:1790772146.145681:0:6678:0:(genops.c:1384:class_connect()) connect: client 9271f5fd-fa87-4f6b-a8bf-0936e195e8be, cookie 0xdf68d9a7d6a901ae 00002000:00100000:0.0:1790772146.145693:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9271f5fd-fa87-4f6b-a8bf-0936e195e8be/ffff8df27d3b4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790772146.145729:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790772146.145999:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790772146.146031:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8df141321000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772146.146098:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2346:x1877760412772992:12345-192.168.206.27@tcp:8:bash.0 Request processed in 476us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772146.146107:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:1.0:1790772146.151205:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772146.151418:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412773120 00000100:00100000:3.0:1790772146.151430:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412773120 00000100:00100000:3.0:1790772146.151527:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:3.0:1790772146.151540:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:0:x1877760412773120:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1790772146.151589:0:8509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772146.151619:0:8509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a901b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a12 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772146.151651:0:8509:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772146.151695:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=312s v=(0 0) 00010000:00010000:3.0:1790772146.151701:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772146.151722:0:8509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a901b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a12 expref: 7 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.151748:0:8509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a901b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a12 expref: 7 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.151765:0:8509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2400, rc 0) 00000100:00100000:3.0:1790772146.151850:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:0:x1877760412773120:12345-192.168.206.27@tcp:101:bash.0 Request processed in 312us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772146.151859:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00080000:1.0:1790772146.152366:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772146.163664:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772146.163944:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412773248 00000100:00100000:3.0:1790772146.163958:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412773248 00000100:00100000:3.0:1790772146.164034:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:3.0:1790772146.164045:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:10281:x1877760412773248:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1790772146.164069:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772146.164092:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a19 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.164133:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a901b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a12 expref: 8 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.164158:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772146.164163:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772146.164169:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.164231:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a901b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a12 expref: 8 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.164248:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a901b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a12 expref: 8 pid: 8509 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772146.164263:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1877760428536704:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772146.164377:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df249225300 going to sleep for 11 seconds 00000100:00100000:3.0:1790772146.174430:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772146.175591:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1877760428536704:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772146.175639:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.175667:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3400, rc 0) 00000100:00100000:1.0:1790772146.175757:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:10281:x1877760412773248:12345-192.168.206.27@tcp:101:bash.0 Request processed in 11713us (12107us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772146.175767:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:2.0:1790772146.176004:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412773376 00000100:00100000:2.0:1790772146.176014:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412773376 00010000:00010000:2.0:1790772146.176054:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a901b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a12 expref: 8 pid: 8509 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772146.176098:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:2.0:1790772146.176107:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412773376:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772146.176124:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772146.176165:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a901b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a12 expref: 8 pid: 8509 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.176178:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a901b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a12 expref: 8 pid: 8509 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.176228:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a901b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a12 expref: 8 pid: 8509 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.176247:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772146.176253:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772146.176262:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.176274:0:5810:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.176315:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772146.176332:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5810:1877760428536832:192.168.206.27@tcp:105: 00000100:00100000:2.0:1790772146.176400:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f7673c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772146.183348:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772146.183428:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412773632 00000100:00100000:3.0:1790772146.183451:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412773632 00000100:00100000:3.0:1790772146.183530:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:2.0:1790772146.183539:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5810:1877760428536832:192.168.206.27@tcp:105: 00000100:00100000:3.0:1790772146.183544:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:10281:x1877760412773632:12345-192.168.206.27@tcp:35:bash.0 00010000:00010000:2.0:1790772146.183602:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772146.183678:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412773376:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 7571us (9259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772146.183689:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:3.0:1790772146.184009:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10281:x1877760412773632:12345-192.168.206.27@tcp:35:bash.0 Request processed in 469us (675us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790772146.184017:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00010000:00010000:3.0:1790772146.207781:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772146.277731:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772146.277880:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412773888 00000100:00100000:2.0:1790772146.277894:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412773888 00000100:00100000:2.0:1790772146.277962:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:2.0:1790772146.277992:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10291:x1877760412773888:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772146.278025:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772146.278053:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a901c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a20 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772146.278169:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790772146.278328:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a901c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a20 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.278345:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57200) 00010000:00010000:2.0:1790772146.278349:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772146.278355:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a901c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a20 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.278372:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aac00, rc 0) 00000100:00100000:2.0:1790772146.278761:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:10291:x1877760412773888:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 771us (1057us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1790772146.278770:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:2.0:1790772146.281116:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772146.281218:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412774144 00000100:00100000:0.0:1790772146.281231:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412774144 00000100:00100000:0.0:1790772146.281293:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1790772146.281304:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:10291:x1877760412774144:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772146.281761:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:10291:x1877760412774144:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 457us (655us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1790772146.282009:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:1.0:1790772146.342416:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772146.342583:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412774272 00000100:00100000:2.0:1790772146.342597:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412774272 00000100:00100000:2.0:1790772146.342673:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:2.0:1790772146.342685:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:10297:x1877760412774272:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772146.342727:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772146.342753:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a901d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a27 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.342879:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a901d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.342897:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a901d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.342911:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a901d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772146.342954:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790772146.342958:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772146.342981:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a901d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.343025:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a901d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a27 expref: 18 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.343048:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a901d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a27 expref: 17 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.343057:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:2.0:1790772146.343060:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772146.343065:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa800, rc 0) 00000100:00100000:2.0:1790772146.343260:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:10297:x1877760412774272:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 577us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772146.343268:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:1.0:1790772146.348626:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772146.348800:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412774528 00000100:00100000:2.0:1790772146.348813:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412774528 00000100:00100000:2.0:1790772146.349154:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:2.0:1790772146.349166:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:10297:x1877760412774528:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772146.349193:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772146.349219:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a901df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a2e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.349345:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a901e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.349363:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a901e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.349377:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a901e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772146.349389:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790772146.349580:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a901df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a2e expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.349602:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a901e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a2e expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.349612:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001f00) 00010000:00010000:2.0:1790772146.349615:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772146.349619:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab600, rc 0) 00000100:00100000:2.0:1790772146.349705:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10297:x1877760412774528:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 541us (1091us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790772146.349726:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:2.0:1790772146.359094:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772146.359176:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772146.362936:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412774912 00000100:00100000:1.0:1790772146.362956:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412774912 00000100:00100000:1.0:1790772146.363082:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:1.0:1790772146.363095:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10297:x1877760412774912:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772146.363137:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772146.363164:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a901f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a35 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.363279:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a901fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.363294:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a901fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.363306:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a901fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772146.363319:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790772146.363465:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a901f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a35 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.363486:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a901fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a35 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.363496:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001f00) 00010000:00010000:1.0:1790772146.363499:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790772146.363503:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8800, rc 0) 00000100:00100000:1.0:1790772146.363639:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10297:x1877760412774912:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 547us (4463us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1790772146.363647:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:0.0:1790772146.364183:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412774656 00000100:00100000:0.0:1790772146.364193:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412774656 00000100:00100000:0.0:1790772146.364245:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:0.0:1790772146.364254:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:2348:x1877760412774656:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772146.364280:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772146.364299:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a901e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a2e expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.364315:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001f00) 00010000:00010000:0.0:1790772146.364320:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772146.364364:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:2348:x1877760412774656:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 112us (5284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772146.364371:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:2.0:1790772146.374441:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772146.374679:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412775040 00000100:00100000:3.0:1790772146.374693:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412775040 00000100:00100000:3.0:1790772146.374774:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:3.0:1790772146.374786:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2350:x1877760412775040:12345-192.168.206.27@tcp:1:lfs.0 00010000:00010000:3.0:1790772146.374855:0:8509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.374902:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.374912:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772146.374917:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772146.374927:0:8509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.374970:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.374985:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 7 pid: 6677 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772146.375002:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8509:1877760428536960:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772146.375417:0:8509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df249225480 going to sleep for 11 seconds 00000100:00100000:0.0:1790772146.382041:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8509:1877760428536960:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772146.382084:0:8509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772146.382123:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772146.382180:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412775168 00000100:00100000:0.0:1790772146.382190:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412775168 00002000:00100000:0.0:1790772146.382250:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8df2745ab100 x1877760412775168/t0(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:492/0 lens 504/0 e 0 to 0 dl 1790772157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790772146.382261:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2745ab100 with x1877760412775168 ext(0->12) 00010000:00010000:0.0:1790772146.382269:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 8 pid: 6677 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.382284:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 8 pid: 6677 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772146.382291:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df2745ab100 00000100:00100000:0.0:1790772146.382334:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:0.0:1790772146.382362:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412775168:12345-192.168.206.27@tcp:4:lfs.0 00000001:00100000:1.0:1790772146.431834:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000100:00100000:2.0:1790772146.432685:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2348:x1877760412775168:12345-192.168.206.27@tcp:4:lfs.0 Request processed in 50315us (50562us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790772146.432718:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00002000:00100000:2.0:1790772146.432736:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8df2745ab100 x1877760412775168/t4294967299(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:492/0 lens 504/448 e 0 to 0 dl 1790772157 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790772146.432749:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2745ab100 with x1877760412775168 ext(0->12) 00010000:00010000:2.0:1790772146.432762:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 9 pid: 6677 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.432785:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 9 pid: 6677 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772146.432795:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df2745ab100 00000100:00100000:1.0:1790772146.444774:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772146.445315:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412775296 00000100:00100000:3.0:1790772146.445330:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412775296 00010000:00010000:3.0:1790772146.445385:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 9 pid: 6677 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772146.445443:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:3.0:1790772146.445455:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2347:x1877760412775296:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772146.445474:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790772146.445517:0:7617:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790772146.445521:0:7617:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790772145 00002000:00010000:3.0:1790772146.445523:0:7617:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790772145 00002000:00010000:3.0:1790772146.445525:0:7617:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790772145 00010000:00010000:3.0:1790772146.445533:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 9 pid: 6677 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.445575:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 9 pid: 6677 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.445606:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a901bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a19 expref: 9 pid: 6677 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.445628:0:7617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772146.445634:0:7617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772146.445641:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.445653:0:7617:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772146.445692:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772146.445833:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412775296:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 379us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772146.445842:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00010000:00010000:0.0:1790772146.445919:0:8509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.445930:0:8509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.445960:0:8509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.445969:0:8509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.445978:0:8509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.445985:0:8509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772146.445990:0:8509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.446005:0:8509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.446019:0:8509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.446041:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90209 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772146.446108:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2350:x1877760412775040:12345-192.168.206.27@tcp:1:lfs.0 Request processed in 71325us (71682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772146.446127:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:1.0:1790772146.461625:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772146.461744:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412775552 00000100:00100000:3.0:1790772146.461758:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412775552 00000100:00100000:3.0:1790772146.461831:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:3.0:1790772146.461859:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:10297:x1877760412775552:12345-192.168.206.27@tcp:35:lfs.0 00000004:00010000:3.0:1790772146.461959:0:5827:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a901fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a35 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790772146.462506:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1790772146.462610:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1790772146.464917:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1790772146.465230:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.465255:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a0b expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.465266:0:5827:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.465316:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a0b expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.465352:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a0b expref: 24 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772146.465371:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5827:1877760428537088:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772146.466422:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f767b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772146.470384:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772146.470459:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5827:1877760428537088:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772146.470495:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772146.470766:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412775680 00000100:00100000:0.0:1790772146.470776:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412775680 00010000:00010000:0.0:1790772146.470823:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a0b expref: 25 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772146.470874:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:0.0:1790772146.470885:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:2348:x1877760412775680:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772146.470904:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772146.470913:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a0b expref: 25 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.470926:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a0b expref: 25 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.470953:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a901a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a0b expref: 25 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.470971:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001f00) 00010000:00010000:0.0:1790772146.470976:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.471014:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.471022:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.471061:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772146.471260:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:2348:x1877760412775680:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 376us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772146.471270:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00010000:00010000:2.0:1790772146.471872:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.471885:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772146.472395:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1790772146.472891:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1790772146.473264:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428537216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790772146.473343:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772146.473456:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f7673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772146.473516:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428537216 00000100:00100000:3.0:1790772146.473525:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428537216 00000100:00100000:2.0:1790772146.473760:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790772146.473808:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772146.473888:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5827:x1877760428537216:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790772146.474102:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5827:x1877760428537216:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 218us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772146.474173:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772146.474225:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428537216:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790772146.475449:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1790772146.476177:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428537344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790772146.476261:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772146.476303:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f767b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772146.476418:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428537344 00000100:00100000:3.0:1790772146.476428:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428537344 00000100:00100000:3.0:1790772146.476495:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790772146.476505:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5827:x1877760428537344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790772146.480430:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5827:x1877760428537344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 3913us (4155us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790772146.480448:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772146.480545:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428537344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790772146.480657:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1790772146.480724:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.480737:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.480746:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.480752:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aac00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772146.480757:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.480777:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.480796:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001f00) 00010000:00010000:2.0:1790772146.480799:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790772146.480805:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.480812:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90210 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790772146.481241:0:5827:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790772146.481525:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1790772146.481538:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312625988520ns, next at 313625986155ns, rc = 0 00000001:00080000:2.0:1790772146.481583:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1790772146.481628:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001f00) 00010000:00010000:2.0:1790772146.481632:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790772146.481642:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a901fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a35 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772146.481805:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10297:x1877760412775552:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 19947us (20193us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1790772146.481816:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000020:00080000:2.0:1790772146.481821:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790772146.484613:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772146.484703:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412775808 00000100:00100000:1.0:1790772146.484734:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412775808 00000100:00100000:1.0:1790772146.485028:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:1.0:1790772146.485041:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10297:x1877760412775808:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772146.485279:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772146.485311:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9e00/0xdf68d9a7d6a90217 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a3c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.485406:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9e00/0xdf68d9a7d6a90217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a3c expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.485421:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9e00/0xdf68d9a7d6a90217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a3c expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.485582:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:1.0:1790772146.485587:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772146.485591:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9e00, rc 0) 00000100:00100000:1.0:1790772146.485688:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:10297:x1877760412775808:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 649us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772146.485696:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:1.0:1790772146.490808:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772146.491889:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412776064 00000100:00100000:2.0:1790772146.491906:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412776064 00000100:00100000:2.0:1790772146.491975:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:2.0:1790772146.491987:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25dbd2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:10297:x1877760412776064:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1790772146.492450:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25dbd2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:10297:x1877760412776064:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 464us (1655us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1790772146.492469:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:3.0:1790772146.587496:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772146.587840:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412776320 00000100:00100000:1.0:1790772146.587855:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412776320 00000100:00100000:1.0:1790772146.588245:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:1.0:1790772146.588258:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:10307:x1877760412776320:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772146.588314:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772146.588341:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9021e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a43 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772146.588456:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790772146.588641:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9021e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a43 expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.588656:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57200) 00010000:00010000:1.0:1790772146.588659:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772146.588664:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9021e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a43 expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.588680:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9c00, rc 0) 00000100:00100000:1.0:1790772146.589038:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:10307:x1877760412776320:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 781us (1557us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1790772146.589047:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:0.0:1790772146.592529:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772146.592825:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412776448 00000100:00100000:1.0:1790772146.592838:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412776448 00000100:00100000:1.0:1790772146.593059:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:1.0:1790772146.593072:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:10307:x1877760412776448:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:1.0:1790772146.593184:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9022c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593206:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9022c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593221:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9022c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593256:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90233 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593264:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593271:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593380:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593390:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593396:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772146.593449:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593462:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9022c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593469:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9022c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593476:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9022c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593482:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772146.593487:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9022c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593502:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9022c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593517:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:1.0:1790772146.593520:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772146.593526:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9022c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593533:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9022c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593599:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593605:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90233 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593611:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593616:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772146.593619:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593624:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90233 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593631:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df27c001900) 00010000:00010000:1.0:1790772146.593633:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772146.593635:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90233 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593650:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593666:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593672:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593678:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593682:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772146.593685:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593690:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593698:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:1.0:1790772146.593701:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772146.593704:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.593722:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9023a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772146.593813:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:10307:x1877760412776448:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 741us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772146.593822:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:3.0:1790772146.600793:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772146.600917:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412776704 00000100:00100000:0.0:1790772146.600932:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412776704 00000100:00100000:0.0:1790772146.601005:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:0.0:1790772146.601017:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:10307:x1877760412776704:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772146.601370:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+31:10307:x1877760412776704:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 353us (602us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1790772146.601379:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:3.0:1790772146.634150:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772146.634485:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412776960 00000100:00100000:2.0:1790772146.634499:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412776960 00000100:00100000:2.0:1790772146.634690:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:2.0:1790772146.634731:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+31:10310:x1877760412776960:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772146.634775:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772146.634803:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90241 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a4a expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.634928:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90248 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.634947:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90248 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.634960:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90248 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.634977:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9024f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.634999:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9024f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635007:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9024f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635153:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635162:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635169:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772146.635179:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790772146.635775:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90248 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635786:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90248 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635803:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90248 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635809:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aae00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772146.635814:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90248 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635823:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90248 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635838:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:2.0:1790772146.635841:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772146.635846:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90248 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635852:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90248 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635868:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9024f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635874:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9024f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635881:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9024f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635886:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772146.635889:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9024f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635906:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9024f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635914:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df25a490f00) 00010000:00010000:2.0:1790772146.635916:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772146.635919:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9024f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635925:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9024f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.635979:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90241 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a4a expref: 34 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.636144:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a4a expref: 33 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.636152:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:2.0:1790772146.636155:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772146.636157:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab600, rc 0) 00000100:00100000:2.0:1790772146.636420:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:10310:x1877760412776960:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1691us (2283us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1790772146.636430:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:3.0:1790772146.640615:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772146.640732:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412777088 00000100:00100000:0.0:1790772146.640744:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412777088 00000100:00100000:0.0:1790772146.640815:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:0.0:1790772146.640825:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:10310:x1877760412777088:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1790772146.640912:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.640955:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.640969:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.641015:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.641023:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90264 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.641031:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.641037:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772146.641042:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.641050:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.641062:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:0.0:1790772146.641066:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772146.641071:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90264 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.641076:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772146.641171:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:10310:x1877760412777088:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 346us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772146.641186:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:3.0:1790772146.644224:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772146.647121:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412777344 00000100:00100000:0.0:1790772146.647145:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412777344 00000100:00100000:0.0:1790772146.647396:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1790772146.647410:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:10310:x1877760412777344:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772146.647777:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+34:10310:x1877760412777344:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 361us (3557us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1790772146.647787:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:3.0:1790772146.885542:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772146.885972:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412777600 00000100:00100000:1.0:1790772146.885984:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412777600 00000100:00100000:1.0:1790772146.886115:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:1.0:1790772146.886128:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+34:10341:x1877760412777600:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:1.0:1790772146.886172:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772146.886199:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9026b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a51 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.886321:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.886339:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.886354:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772146.886366:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790772146.886576:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9026b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a51 expref: 37 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.886599:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a51 expref: 36 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.886608:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:1.0:1790772146.886611:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772146.886615:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8600, rc 0) 00000100:00100000:1.0:1790772146.886693:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:10341:x1877760412777600:12345-192.168.206.27@tcp:101:cat.0 Request processed in 567us (1165us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1790772146.886735:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:3.0:1790772146.897635:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772146.897729:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412777728 00000100:00100000:1.0:1790772146.897742:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412777728 00000100:00100000:1.0:1790772146.897824:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:1.0:1790772146.897836:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246095c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:2348:x1877760412777728:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772146.897854:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772146.897883:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90272 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a51 expref: 36 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.897905:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:1.0:1790772146.897911:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772146.897986:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246095c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:2348:x1877760412777728:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 152us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772146.897994:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:3.0:1790772146.898980:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772146.899096:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412777984 00000100:00100000:2.0:1790772146.899105:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412777984 00000100:00100000:2.0:1790772146.899240:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:2.0:1790772146.899251:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:10341:x1877760412777984:12345-192.168.206.27@tcp:35:cat.0 00000100:00100000:2.0:1790772146.899604:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:10341:x1877760412777984:12345-192.168.206.27@tcp:35:cat.0 Request processed in 354us (629us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1790772146.899612:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:3.0:1790772146.956474:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772146.956658:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412778240 00000100:00100000:0.0:1790772146.956671:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412778240 00000100:00100000:0.0:1790772146.956753:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:0.0:1790772146.956776:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:10347:x1877760412778240:12345-192.168.206.27@tcp:101:dd.0 00010000:00010000:0.0:1790772146.956816:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772146.956820:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790772146.956853:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a901d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a27 expref: 36 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.956879:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772146.956885:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772146.956901:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90280 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a58 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.957034:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.957052:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a4a expref: 36 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.957078:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.957117:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a4a expref: 36 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.957134:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a4a expref: 36 pid: 6701 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772146.957151:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27af05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428537472:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772146.957273:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa480 going to sleep for 11 seconds 00000100:00100000:3.0:1790772146.963729:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772146.963944:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412778368 00000100:00100000:1.0:1790772146.963959:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412778368 00000100:00100000:0.0:1790772146.964010:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27af05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428537472:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772146.964011:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a4a expref: 37 pid: 6701 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.964062:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772146.964751:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:1.0:1790772146.964766:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+37:2348:x1877760412778368:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772146.964783:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772146.964791:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a4a expref: 37 pid: 6701 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.964804:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a4a expref: 37 pid: 6701 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.964839:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a4a expref: 37 pid: 6701 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.964855:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:1.0:1790772146.964860:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.964868:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.964875:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772146.964988:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772146.965056:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:2348:x1877760412778368:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 294us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772146.965064:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00010000:00010000:0.0:1790772146.966164:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.966203:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772146.966241:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790772146.966519:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90280 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a58 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.966582:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a58 expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.966616:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:0.0:1790772146.966620:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790772146.966624:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9a00, rc 0) 00000100:00100000:0.0:1790772146.966992:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:10347:x1877760412778240:12345-192.168.206.27@tcp:101:dd.0 Request processed in 10226us (10529us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1790772146.967011:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:3.0:1790772146.970642:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772146.970840:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412778624 00000100:00100000:2.0:1790772146.970849:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412778624 00000100:00100000:2.0:1790772146.970912:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:2.0:1790772146.970922:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:10347:x1877760412778624:12345-192.168.206.27@tcp:36:dd.0 00010000:00010000:2.0:1790772146.971175:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.971192:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772146.971203:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772146.971544:0:6701:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1790772146.971611:0:6701:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b7746f73 reply state 00000000e363d2ca transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772146.971622:0:6701:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772146.971728:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+39:10347:x1877760412778624:12345-192.168.206.27@tcp:36:dd.0 Request processed in 805us (1094us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1790772146.971736:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 52 00000020:00080000:2.0:1790772146.971740:0:6701:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790772146.975369:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.975386:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.975394:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.975400:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aac00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772146.975405:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.975412:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.975426:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:0.0:1790772146.975429:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772146.975434:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772146.975439:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90295 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.232041:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772147.240296:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772147.240390:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412778752 00000100:00100000:2.0:1790772147.240404:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412778752 00000100:00100000:2.0:1790772147.240486:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:2.0:1790772147.240498:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+38:10361:x1877760412778752:12345-192.168.206.27@tcp:101:stat.0 00010000:00010000:2.0:1790772147.240539:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772147.240599:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9029c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a5f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.240682:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.240699:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.240723:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.240739:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.240748:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.240755:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.241086:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.241100:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a58 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.241110:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.241329:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a58 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.241354:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a58 expref: 39 pid: 5823 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772147.241371:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877760428537600:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772147.241489:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f7679c0 going to sleep for 11 seconds 00000100:00080000:1.0:1790772147.243511:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772147.247955:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877760428537600:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772147.248005:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772147.259064:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772147.259420:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412779008 00000100:00100000:3.0:1790772147.259432:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412779008 00000100:00100000:3.0:1790772147.259538:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:3.0:1790772147.259587:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+40:5587:x1877760412779008:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790772147.260701:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:5587:x1877760412779008:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 1146us (1641us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1790772147.260722:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:3.0:1790772147.264407:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772147.264635:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412779136 00000100:00100000:0.0:1790772147.264648:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412779136 00010000:00010000:0.0:1790772147.264697:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a58 expref: 41 pid: 5823 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772147.264757:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:0.0:1790772147.264767:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:2347:x1877760412779136:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772147.264785:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772147.264792:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a58 expref: 41 pid: 5823 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.264814:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a58 expref: 41 pid: 5823 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.264851:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90287 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a58 expref: 41 pid: 5823 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.264881:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:0.0:1790772147.264888:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.264899:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.264909:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.264938:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772147.265019:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+40:2347:x1877760412779136:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 253us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772147.265027:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00010000:00010000:0.0:1790772147.265416:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265426:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772147.265538:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790772147.265544:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772147.265661:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265679:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265691:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265699:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265717:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265724:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aae00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772147.265730:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265739:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265762:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772147.265764:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772147.265770:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265778:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265792:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265799:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265806:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265811:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abe00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772147.265814:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265820:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265828:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df25a490f00) 00010000:00010000:0.0:1790772147.265841:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772147.265845:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.265851:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.266333:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a9029c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a5f expref: 40 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.266351:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a5f expref: 39 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.266360:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:0.0:1790772147.266362:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772147.266365:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aba00, rc 0) 00000100:00100000:0.0:1790772147.266435:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+39:10361:x1877760412778752:12345-192.168.206.27@tcp:101:stat.0 Request processed in 25939us (26153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772147.268109:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00000001:00080000:1.0:1790772147.270582:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000001:00080000:1.0:1790772147.270625:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:1.0:1790772147.270639:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1790772147.270657:0:5845:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df27fcfad80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1790772147.270662:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df247ee1400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df27fcfae40 00000020:00080000:1.0:1790772147.270665:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df247ee1800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df2451aa800 00000020:00080000:0.0:1790772147.270791:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1790772147.271247:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790772147.271569:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772147.271595:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428537728:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790772147.271685:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772147.271823:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428537728 00000100:00100000:2.0:1790772147.271845:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428537728 00000100:00100000:2.0:1790772147.272060:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790772147.272071:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3295:x1877760428537728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790772147.272106:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1790772147.272500:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abd03b1, atime: 0x6abd03b1, ctime: 0x6abd03b1, blocks: 0x1 00010000:00010000:2.0:1790772147.272512:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a902b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.272533:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1790772147.272538:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772147.272545:0:6678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a902b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.272609:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a902b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.272638:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a902b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.272648:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a902b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.272672:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772147.273081:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772147.273090:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a902b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.273099:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772147.273103:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a902b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.273124:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a902b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.273153:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a902b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.273160:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a902b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.273187:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772147.273189:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772147.273191:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772147.274429:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428537728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2354us (2738us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790772147.274444:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1790772147.274642:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df26f3e8a80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1790772147.274650:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428537728:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790772147.386926:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772147.387035:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412779392 00000100:00100000:2.0:1790772147.387048:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412779392 00000100:00100000:2.0:1790772147.387118:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00100000:2.0:1790772147.387129:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+12:10367:x1877760412779392:12345-192.168.206.27@tcp:36:truncate.0 00010000:00010000:2.0:1790772147.387202:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772147.387235:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a902b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a5f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.387257:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:2.0:1790772147.387262:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772147.387502:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.387519:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.387615:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772147.387678:0:6701:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1790772147.387718:0:6701:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000210ef1ff reply state 00000000d2e1a32c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772147.387728:0:6701:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772147.387940:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10367:x1877760412779392:12345-192.168.206.27@tcp:36:truncate.0 Request processed in 811us (1024us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1790772147.387948:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 54 00000020:00080000:2.0:1790772147.387954:0:6701:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790772147.394280:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.394304:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.394313:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.394321:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772147.394328:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.394336:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.394356:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:1.0:1790772147.394359:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772147.394365:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.394371:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a902bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772147.596801:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772147.596889:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412779520 00000100:00100000:1.0:1790772147.596903:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412779520 00000100:00100000:1.0:1790772147.596981:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:1.0:1790772147.596993:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:10381:x1877760412779520:12345-192.168.206.27@tcp:101:stat.0 00010000:00010000:1.0:1790772147.597038:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772147.597064:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a902c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a66 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597172:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a902cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597195:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a902cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597209:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a902cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597226:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a902d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597232:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a902d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597239:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a902d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597665:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597676:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597683:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772147.597739:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1790772147.597744:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772147.597775:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597800:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597810:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a902cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597817:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a902cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597824:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a902cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597831:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772147.597836:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a902cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597845:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a902cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597859:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:1.0:1790772147.597863:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772147.597869:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a902cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597875:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a902cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597889:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a902d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597896:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a902d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597909:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a902d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597914:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772147.597917:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a902d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597924:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a902d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597932:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df27c001900) 00010000:00010000:1.0:1790772147.597934:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772147.597938:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a902d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597943:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a902d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597981:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a902c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a66 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.597995:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a66 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.598003:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:1.0:1790772147.598005:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772147.598008:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9400, rc 0) 00000100:00100000:1.0:1790772147.598080:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10381:x1877760412779520:12345-192.168.206.27@tcp:101:stat.0 Request processed in 1089us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772147.598098:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:2.0:1790772147.680423:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428537856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772147.680519:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772147.680871:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428537856 00000100:00100000:3.0:1790772147.680882:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428537856 00000100:00100000:3.0:1790772147.680949:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790772147.680960:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1877760428537856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772147.680990:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772147.681052:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1877760428537856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772147.681061:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790772147.681118:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428537856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772147.685597:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27fcaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428537984:0@lo:400:kworker.0 00000100:00100000:2.0:1790772147.685691:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772147.686114:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428538368:0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.686156:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772147.686214:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27fcab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428538240:0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.686241:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772147.686263:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772147.686269:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27fcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428538112:0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.686290:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772147.686333:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428538368 00000100:00100000:0.0:1790772147.686343:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428538368 00000100:00100000:0.0:1790772147.686407:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428538240 00000100:00100000:0.0:1790772147.686411:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428538240 00000100:00100000:0.0:1790772147.686426:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428538112 00000100:00100000:0.0:1790772147.686445:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428538112 00000100:00100000:0.0:1790772147.686467:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790772147.686478:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428538368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.686580:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428538368:12345-0@lo:400:kworker.0 Request processed in 103us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772147.686589:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790772147.686612:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790772147.686618:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428538240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.686653:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428538240:12345-0@lo:400:kworker.0 Request processed in 36us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772147.686659:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790772147.686670:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790772147.686675:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428538112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.686715:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428538112:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772147.686721:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790772147.686773:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27fcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428538112:0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.686841:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27fcab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428538240:0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.686884:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428538368:0@lo:400:kworker.0 00000100:00080000:0.0:1790772147.686912:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772147.687884:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428537984 00000100:00100000:3.0:1790772147.687893:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428537984 00000100:00100000:3.0:1790772147.687949:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790772147.687957:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428537984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.692686:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772147.692724:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428538496:0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.692824:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772147.693110:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428537984:12345-0@lo:400:kworker.0 Request processed in 5150us (7416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772147.693124:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790772147.693192:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428538496 00000100:00100000:3.0:1790772147.693200:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428538496 00000100:00100000:3.0:1790772147.693259:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790772147.693269:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428538496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772147.693351:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428538496:12345-0@lo:400:kworker.0 Request processed in 84us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772147.693359:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1790772147.693379:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772147.693417:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428538496:0@lo:400:kworker.0 00000100:00100000:2.0:1790772147.699335:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27fcaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428537984:0@lo:400:kworker.0 00000100:00100000:0.0:1790772147.705349:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772147.705461:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412779776 00000100:00100000:2.0:1790772147.705475:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412779776 00000100:00100000:2.0:1790772147.705544:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:2.0:1790772147.705577:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10391:x1877760412779776:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772147.705603:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772147.705629:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a902e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a6d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772147.705800:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790772147.705963:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a902e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a6d expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.705991:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57200) 00010000:00010000:2.0:1790772147.705995:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772147.706000:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a902e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a6d expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.706017:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab200, rc 0) 00000100:00100000:2.0:1790772147.706098:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:10391:x1877760412779776:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 523us (765us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1790772147.706108:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:2.0:1790772147.709282:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772147.709386:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412780032 00000100:00100000:0.0:1790772147.709417:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412780032 00000100:00100000:0.0:1790772147.709489:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1790772147.709500:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:10391:x1877760412780032:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772147.709871:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:10391:x1877760412780032:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 370us (599us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1790772147.709880:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:1.0:1790772147.753437:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772147.753486:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772147.753525:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772147.753656:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412780288 00000100:00100000:2.0:1790772147.753670:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412780288 00000100:00100000:2.0:1790772147.753751:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:2.0:1790772147.753774:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412780288:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772147.753869:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412780288:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 109us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772147.753878:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:0.0:1790772147.754304:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412780416 00000100:00100000:0.0:1790772147.754311:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412780416 00000100:00100000:0.0:1790772147.754372:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 134 00000100:00100000:0.0:1790772147.754380:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412780416:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772147.754428:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412780416:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 49us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772147.754435:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 134 00000100:00100000:3.0:1790772147.754604:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412780160 00000100:00100000:3.0:1790772147.754609:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412780160 00000100:00100000:3.0:1790772147.754649:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 285 00000100:00100000:3.0:1790772147.754657:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2347:x1877760412780160:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772147.754687:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2347:x1877760412780160:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 31us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772147.754694:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 285 00000100:00080000:2.0:1790772147.754875:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772147.809211:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772147.809369:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412780672 00000100:00100000:2.0:1790772147.809382:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412780672 00000100:00100000:2.0:1790772147.809496:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:2.0:1790772147.809507:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:10398:x1877760412780672:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1790772147.809538:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772147.809582:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a74 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.809747:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.809765:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a66 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.809775:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.809816:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a66 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.809831:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a66 expref: 17 pid: 5823 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772147.809858:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877760428538624:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772147.810028:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f7670c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772147.821300:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772147.821817:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412780800 00000100:00100000:3.0:1790772147.821830:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412780800 00010000:00010000:3.0:1790772147.821898:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a66 expref: 18 pid: 5823 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772147.821949:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:3.0:1790772147.821959:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+18:2347:x1877760412780800:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772147.821976:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772147.821984:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a66 expref: 18 pid: 5823 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772147.821998:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a66 expref: 18 pid: 5823 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772147.822045:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:3.0:1790772147.822051:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772147.822062:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772147.822070:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772147.822115:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772147.822192:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+18:2347:x1877760412780800:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 233us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772147.822200:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 40 00010000:00010000:2.0:1790772147.822893:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a902db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a66 expref: 17 pid: 5823 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772147.822918:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877760428538624:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772147.822945:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.822956:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.822977:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772147.823004:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1790772147.823196:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a902f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a74 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.823345:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a74 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.823364:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:2.0:1790772147.823370:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790772147.823373:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aae00, rc 0) 00000100:00100000:2.0:1790772147.823498:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:10398:x1877760412780672:12345-192.168.206.27@tcp:101:bash.0 Request processed in 13991us (14404us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1790772147.823507:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:1.0:1790772147.827344:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772147.829776:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412781056 00000100:00100000:0.0:1790772147.829798:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412781056 00000100:00100000:0.0:1790772147.829892:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:0.0:1790772147.829904:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:10398:x1877760412781056:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:0.0:1790772147.830273:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.830297:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.830311:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772147.831087:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1790772147.831135:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005ae80611 reply state 0000000073f36aef transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772147.831164:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772147.831408:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:10398:x1877760412781056:12345-192.168.206.27@tcp:36:bash.0 Request processed in 1501us (4074us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1790772147.831417:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 58 00000020:00080000:0.0:1790772147.831424:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790772147.834843:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.834864:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.834872:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.834879:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772147.834884:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.834892:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.834910:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:0.0:1790772147.834913:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772147.834918:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.834924:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90305 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772147.838741:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772147.839599:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412781184 00000100:00100000:0.0:1790772147.839630:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412781184 00000100:00100000:0.0:1790772147.839718:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:0.0:1790772147.839731:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10398:x1877760412781184:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1790772147.839774:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772147.839804:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9030c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a7b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.839912:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.839929:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a74 expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.839940:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.840044:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a74 expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.840070:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a74 expref: 20 pid: 5825 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772147.840087:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27af05500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428538752:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772147.840199:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1240 going to sleep for 11 seconds 00000100:00100000:0.0:1790772147.843511:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27af05500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428538752:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772147.843905:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772147.844669:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412781312 00000100:00100000:2.0:1790772147.844680:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412781312 00010000:00010000:2.0:1790772147.844750:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a74 expref: 21 pid: 5825 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772147.844811:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:2.0:1790772147.844822:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:2347:x1877760412781312:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772147.844840:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772147.844846:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a74 expref: 21 pid: 5825 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.844882:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a74 expref: 21 pid: 5825 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.844907:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a902f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a74 expref: 21 pid: 5825 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.844926:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:2.0:1790772147.844933:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.844943:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.844952:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.844972:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772147.845109:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.845121:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.845422:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772147.845477:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790772147.845483:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772147.845509:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.845579:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9030c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a7b expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.845600:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a7b expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.845608:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:0.0:1790772147.845611:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772147.845613:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9600, rc 0) 00000100:00100000:0.0:1790772147.845660:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:10398:x1877760412781184:12345-192.168.206.27@tcp:101:bash.0 Request processed in 5932us (6932us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772147.845668:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:2.0:1790772147.845678:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:2347:x1877760412781312:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 856us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772147.845689:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:2.0:1790772147.849822:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772147.850195:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412781568 00000100:00100000:0.0:1790772147.850208:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412781568 00000100:00100000:0.0:1790772147.850283:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1790772147.850296:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25dbd1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10398:x1877760412781568:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:0.0:1790772147.850682:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25dbd1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:10398:x1877760412781568:12345-192.168.206.27@tcp:35:bash.0 Request processed in 387us (870us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1790772147.850691:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:3.0:1790772147.926885:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772147.927060:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412781824 00000100:00100000:2.0:1790772147.927074:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412781824 00000100:00100000:2.0:1790772147.927154:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1790772147.927166:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:10408:x1877760412781824:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772147.927199:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772147.927225:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a9031a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a82 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772147.927358:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790772147.927756:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a9031a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a82 expref: 22 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.927914:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57200) 00010000:00010000:2.0:1790772147.927918:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772147.927925:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a9031a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a82 expref: 22 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.927944:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aae00, rc 0) 00000100:00100000:2.0:1790772147.928174:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10408:x1877760412781824:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1008us (1303us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1790772147.928183:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:1.0:1790772147.931646:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772147.931790:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412781952 00000100:00100000:2.0:1790772147.931802:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412781952 00000100:00100000:2.0:1790772147.931888:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:2.0:1790772147.931901:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10408:x1877760412781952:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:2.0:1790772147.931997:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90328 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932028:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90328 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932043:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90328 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932070:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9032f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932096:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9032f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932104:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9032f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932434:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932445:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932453:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772147.932502:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932516:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90328 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932523:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90328 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932531:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90328 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932539:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772147.932544:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90328 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932576:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90328 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932597:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:2.0:1790772147.932601:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772147.932668:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90328 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932676:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90328 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932691:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9032f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932698:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9032f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932717:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9032f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932723:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abe00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772147.932726:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9032f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932733:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9032f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932741:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df25a490200) 00010000:00010000:2.0:1790772147.932743:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772147.932746:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9032f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932752:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9032f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932778:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932785:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932791:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932796:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772147.932800:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932806:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932814:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:2.0:1790772147.932816:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772147.932819:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772147.932826:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90336 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772147.932919:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10408:x1877760412781952:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 1019us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772147.932928:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:0.0:1790772147.937968:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772147.942048:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412782208 00000100:00100000:3.0:1790772147.942072:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412782208 00000100:00100000:3.0:1790772147.942333:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:3.0:1790772147.942344:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10408:x1877760412782208:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:3.0:1790772147.942760:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:10408:x1877760412782208:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 416us (4804us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1790772147.942770:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:3.0:1790772147.978958:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772147.979138:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412782464 00000100:00100000:0.0:1790772147.979153:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412782464 00000100:00100000:0.0:1790772147.979225:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:0.0:1790772147.979237:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:10411:x1877760412782464:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772147.979532:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772147.979604:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9033d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a89 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.979782:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a90344 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.979800:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a90344 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.979812:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a90344 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.979829:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9034b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.979836:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9034b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.979842:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9034b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980215:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980238:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980245:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772147.980259:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790772147.980376:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a90344 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980384:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a90344 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980392:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a90344 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980398:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772147.980404:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a90344 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980412:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a90344 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980426:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:1.0:1790772147.980429:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772147.980435:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a90344 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980441:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a90344 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980454:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9034b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980467:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9034b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980473:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9034b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.980479:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772147.981621:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9034b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.981642:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9034b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.981655:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df27c001900) 00010000:00010000:1.0:1790772147.981658:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772147.981661:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9034b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.981668:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9034b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.981752:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9033d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a89 expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.981845:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a89 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772147.981853:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:1.0:1790772147.981855:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772147.981869:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9400, rc 0) 00000100:00100000:1.0:1790772147.982130:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:10411:x1877760412782464:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 2893us (3184us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1790772147.982141:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:1.0:1790772147.988134:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772147.988184:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772147.988267:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412782720 00000100:00100000:3.0:1790772147.988281:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412782720 00000100:00100000:3.0:1790772147.988360:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:3.0:1790772147.988372:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:2349:x1877760412782720:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772147.988412:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772147.988444:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a89 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772147.988465:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:3.0:1790772147.988471:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772147.988697:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:2349:x1877760412782720:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 325us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772147.988717:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:0.0:1790772147.988795:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412782592 00000100:00100000:0.0:1790772147.988800:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412782592 00000100:00100000:0.0:1790772147.988845:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:0.0:1790772147.988853:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:10411:x1877760412782592:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1790772147.988926:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90360 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.988945:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.988962:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.988997:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.989006:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90360 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.989014:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.989033:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772147.989038:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.989047:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90360 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.989057:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:0.0:1790772147.989060:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772147.989064:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90360 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772147.989071:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772147.989119:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:10411:x1877760412782592:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 266us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772147.989127:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:2.0:1790772147.992837:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772147.992973:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412782976 00000100:00100000:0.0:1790772147.992995:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412782976 00000100:00100000:0.0:1790772147.993063:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:0.0:1790772147.993074:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:10411:x1877760412782976:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772147.993375:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:10411:x1877760412782976:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 302us (551us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1790772147.993383:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:2.0:1790772148.133912:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.134119:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412783232 00000100:00100000:0.0:1790772148.134131:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412783232 00000100:00100000:0.0:1790772148.134207:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:0.0:1790772148.134237:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:10429:x1877760412783232:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:0.0:1790772148.134270:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772148.134295:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90367 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a90 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.134428:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9036e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.134446:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9036e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.134460:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9036e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772148.134472:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790772148.134688:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90367 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a90 expref: 27 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.134730:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9036e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a90 expref: 26 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.134740:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:0.0:1790772148.134743:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790772148.134746:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8c00, rc 0) 00000100:00100000:0.0:1790772148.134838:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:10429:x1877760412783232:12345-192.168.206.27@tcp:101:cat.0 Request processed in 604us (940us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1790772148.134847:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:1.0:1790772148.163081:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.163258:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412783360 00000100:00100000:0.0:1790772148.163271:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412783360 00000100:00100000:0.0:1790772148.163356:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00100000:0.0:1790772148.163365:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:10430:x1877760412783360:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772148.163396:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772148.163419:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9037c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a97 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.163691:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90383 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.163722:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.163736:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772148.163784:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790772148.163788:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772148.163806:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.163834:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9037c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a97 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.163859:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a97 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.163868:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772148.163872:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772148.163875:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8200, rc 0) 00000100:00100000:0.0:1790772148.164019:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10430:x1877760412783360:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 653us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772148.164035:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00100000:3.0:1790772148.171325:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.171753:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412783744 00000100:00100000:0.0:1790772148.171833:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412783744 00000100:00100000:0.0:1790772148.171906:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:0.0:1790772148.171917:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10430:x1877760412783744:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772148.172625:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:10430:x1877760412783744:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 704us (1309us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1790772148.172636:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:2.0:1790772148.176730:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.180125:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412783872 00000100:00100000:3.0:1790772148.180149:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412783872 00000100:00100000:3.0:1790772148.180334:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:3.0:1790772148.180346:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:10430:x1877760412783872:12345-192.168.206.27@tcp:103:lfs.0 00010000:00010000:3.0:1790772148.180367:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790772148.180398:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90313 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a7b expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.180431:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9036e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a90 expref: 27 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.180446:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9e00/0xdf68d9a7d6a90217 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a3c expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.180457:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df27c001500) 00010000:00010000:3.0:1790772148.180470:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772148.182272:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:10430:x1877760412783872:12345-192.168.206.27@tcp:103:lfs.0 Request processed in 1919us (5547us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.182286:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:1.0:1790772148.186312:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.186402:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412784000 00000100:00100000:0.0:1790772148.186415:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412784000 00000100:00100000:0.0:1790772148.186571:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00100000:0.0:1790772148.186586:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:10430:x1877760412784000:12345-192.168.206.27@tcp:58:lfs.0 00010000:00010000:0.0:1790772148.186765:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9038a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.186787:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9038a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.186800:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9038a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772148.188127:0:6701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772148.188352:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1790772148.188433:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1790772148.189257:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:10430:x1877760412784000:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 2665us (2950us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772148.189272:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00100000:0.0:1790772148.195377:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428538880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772148.195516:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772148.195742:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428538880 00000100:00100000:3.0:1790772148.195754:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428538880 00000100:00100000:3.0:1790772148.195828:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790772148.195840:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428538880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772148.195886:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772148.195948:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428538880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.195957:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772148.196063:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428538880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772148.217991:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.218134:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412784128 00000100:00100000:3.0:1790772148.218148:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412784128 00000100:00100000:3.0:1790772148.218240:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:3.0:1790772148.218252:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:10432:x1877760412784128:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772148.218281:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772148.218308:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90391 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226a9e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.218393:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90398 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.218412:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90398 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.218425:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90398 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.218442:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9039f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.218468:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9039f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.218475:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9039f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.219876:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.219897:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.219909:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772148.219961:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790772148.219966:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772148.219991:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220004:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220014:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90398 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220022:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90398 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220030:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220038:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772148.220043:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220051:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90398 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220067:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:2.0:1790772148.220081:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772148.220088:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90398 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220096:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90398 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220114:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9039f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220121:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9039f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220128:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9039f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220134:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772148.220137:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9039f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220143:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9039f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220151:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df247e07100) 00010000:00010000:2.0:1790772148.220154:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772148.220158:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9039f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220163:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9039f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220303:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90391 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a9e expref: 27 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220334:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a9e expref: 26 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.220342:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df254043000) 00010000:00010000:2.0:1790772148.220345:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772148.220348:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aac00, rc 0) 00000100:00100000:2.0:1790772148.220447:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:10432:x1877760412784128:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 2195us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772148.220457:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 67 00010000:00010000:1.0:1790772148.256880:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790772148.448117:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772148.448129:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772148.448192:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790772148.448199:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790772148.448353:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428539008:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790772148.448491:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f767480 going to sleep for 11 seconds 00000100:00100000:1.0:1790772148.452660:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772148.452762:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428539008:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790772148.452987:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412784256 00000100:00100000:3.0:1790772148.452996:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412784256 00000100:00100000:3.0:1790772148.453059:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:3.0:1790772148.453071:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:10443:x1877760412784256:12345-192.168.206.27@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790772148.453167:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:10443:x1877760412784256:12345-192.168.206.27@tcp:900:lhsmtool_posix.0 Request processed in 98us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.453175:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:3.0:1790772148.454772:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772148.454871:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412784384 00000100:00100000:1.0:1790772148.454881:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412784384 00000100:00100000:1.0:1790772148.454947:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:1.0:1790772148.454958:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:10443:x1877760412784384:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790772148.455002:0:5824:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790772148.455129:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:10443:x1877760412784384:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 172us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772148.455137:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:1.0:1790772148.461943:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.462056:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412784512 00000100:00100000:0.0:1790772148.462069:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412784512 00000100:00100000:0.0:1790772148.462153:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:0.0:1790772148.462166:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:10443:x1877760412784512:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790772148.462273:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a903ad lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462295:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a903ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462308:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a903ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462325:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462333:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462340:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462371:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462380:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462387:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772148.462450:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790772148.462455:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772148.462472:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462485:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a903ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462493:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a903ad lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462501:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a903ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462508:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772148.462513:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a903ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462521:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a903ad lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462535:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:0.0:1790772148.462538:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772148.462543:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a903ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462597:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a903ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462615:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462634:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903b4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462640:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462646:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772148.462649:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462656:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903b4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462664:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8df254043800) 00010000:00010000:0.0:1790772148.462667:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772148.462670:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903b4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462676:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903b4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462693:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.462711:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.463251:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.463262:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772148.463274:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.463282:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.463292:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df254043000) 00010000:00010000:0.0:1790772148.463295:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772148.463299:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.463305:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a903bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772148.465808:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:10443:x1877760412784512:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 Request processed in 3627us (3862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772148.465826:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:1.0:1790772148.476132:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772148.476182:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412784768 00000100:00100000:1.0:1790772148.476194:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412784768 00000100:00100000:1.0:1790772148.476263:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:1.0:1790772148.476272:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:10443:x1877760412784768:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772148.476330:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772148.476356:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a903c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226aa5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476481:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a903c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476499:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a903c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476511:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a903c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772148.476523:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790772148.476669:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a903c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476678:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a903c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476685:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a903c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476692:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772148.476705:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a903c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476714:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a903c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476727:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df254043000) 00010000:00010000:1.0:1790772148.476736:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790772148.476742:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a903c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476749:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a903c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476800:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a903c2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aa5 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476811:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:1.0:1790772148.476813:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772148.476817:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a903c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aa5 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.476826:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8600, rc 0) 00000100:00100000:1.0:1790772148.476911:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10443:x1877760412784768:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 638us (793us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1790772148.476919:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:2.0:1790772148.488256:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.488372:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412784896 00000100:00100000:3.0:1790772148.488386:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412784896 00000100:00100000:3.0:1790772148.488464:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 71 00000100:00100000:3.0:1790772148.488476:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10443:x1877760412784896:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790772148.488709:0:5825:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790772148.488955:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10443:x1877760412784896:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 478us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772148.488964:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 71 00000100:00100000:2.0:1790772148.503266:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.503429:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412785152 00000100:00100000:3.0:1790772148.503442:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412785152 00000100:00100000:3.0:1790772148.503513:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 72 00000100:00100000:3.0:1790772148.503524:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10443:x1877760412785152:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772148.503567:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772148.503571:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790772148.503605:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a97 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.503637:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:3.0:1790772148.503643:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772148.503661:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a903d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226aac expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790772148.506236:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1790772148.506612:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a903de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.506633:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a903de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.506647:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a903de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.506743:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a903d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aac expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.506764:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a903de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aac expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.506775:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df247e07400) 00010000:00010000:3.0:1790772148.506778:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772148.506782:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3c00, rc 0) 00000100:00100000:3.0:1790772148.511085:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:10443:x1877760412785152:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 7544us (7815us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1790772148.511101:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 72 00000100:00100000:1.0:1790772148.514752:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772148.515033:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412785408 00000100:00100000:2.0:1790772148.515046:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412785408 00000100:00100000:2.0:1790772148.515118:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00100000:2.0:1790772148.515129:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:10443:x1877760412785408:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790772148.515229:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772148.515266:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a903de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aac expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.515303:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df247e07400) 00010000:00010000:2.0:1790772148.515318:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772148.515347:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a903ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.515365:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a903ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.515376:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a903ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.515392:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a903f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa6d5135c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.515399:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a903f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6d5135c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.515406:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a903f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6d5135c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516060:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a903ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516074:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a903ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516082:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a903ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516095:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aba00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772148.516101:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a903ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516109:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a903ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516121:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:2.0:1790772148.516124:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772148.516129:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a903ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516136:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a903ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516147:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a903f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6d5135c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516152:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a903f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6d5135c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516158:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a903f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6d5135c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516163:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772148.516166:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a903f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6d5135c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516172:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a903f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa6d5135c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516190:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa6d5135c (ffff8df25a490200) 00010000:00010000:2.0:1790772148.516193:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772148.516196:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a903f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa6d5135c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.516202:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a903f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa6d5135c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772148.516390:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10443:x1877760412785408:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1258us (1647us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790772148.516400:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00100000:2.0:1790772148.524493:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.524634:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412785536 00000100:00100000:0.0:1790772148.524648:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412785536 00000100:00100000:0.0:1790772148.524730:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:0.0:1790772148.524743:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10443:x1877760412785536:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772148.524769:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772148.524801:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ab3 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.524860:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.524877:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.524914:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.525033:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a903fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ab3 expref: 29 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.525056:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ab3 expref: 28 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.525066:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df254043800) 00010000:00010000:0.0:1790772148.525069:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790772148.525073:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8e00, rc 0) 00000100:00100000:0.0:1790772148.525158:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:10443:x1877760412785536:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 417us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772148.525166:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:3.0:1790772148.530288:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772148.530404:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412785792 00000100:00100000:2.0:1790772148.530417:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412785792 00000100:00100000:2.0:1790772148.530492:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:2.0:1790772148.530505:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:10443:x1877760412785792:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790772148.530727:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.530750:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.530764:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772148.531097:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1790772148.531108:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314675557585ns, next at 315675554940ns, rc = 0 00000004:00010000:2.0:1790772148.531204:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000004a1caab reply state 000000001f82d485 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772148.531233:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772148.531852:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:10443:x1877760412785792:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1345us (1573us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1790772148.531861:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:3.0:1790772148.535422:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.535944:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412785920 00000100:00100000:3.0:1790772148.535957:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412785920 00000100:00100000:3.0:1790772148.536032:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 76 00000100:00100000:3.0:1790772148.536042:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:10443:x1877760412785920:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772148.536074:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772148.536100:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9040f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226aba expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.536181:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9040f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aba expref: 31 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.536205:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9040f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aba expref: 31 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.536230:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df254043800) 00010000:00010000:3.0:1790772148.536234:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790772148.536238:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2a00, rc 0) 00000100:00100000:3.0:1790772148.536314:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+31:10443:x1877760412785920:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 273us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.536322:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 76 00010000:00010000:1.0:1790772148.536806:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.536817:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.536825:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.536832:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772148.536855:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.536865:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.536879:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df254043800) 00010000:00010000:1.0:1790772148.536881:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790772148.536885:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.536891:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90408 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.539634:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772148.540863:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412786048 00000100:00100000:2.0:1790772148.540880:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412786048 00000100:00100000:2.0:1790772148.540948:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:2.0:1790772148.540958:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1877760412786048:12345-192.168.206.27@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1790772148.541000:0:6679:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1790772148.541041:0:6679:0:(genops.c:1384:class_connect()) connect: client 9271f5fd-fa87-4f6b-a8bf-0936e195e8be, cookie 0xdf68d9a7d6a90416 00002000:00100000:2.0:1790772148.541056:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9271f5fd-fa87-4f6b-a8bf-0936e195e8be/ffff8df26f773000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790772148.541072:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790772148.541777:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790772148.541824:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8df26f772000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772148.541930:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2346:x1877760412786048:12345-192.168.206.27@tcp:8:lhsmtool_posix.0 Request processed in 971us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772148.541939:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:2.0:1790772148.550434:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.550648:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412786176 00000100:00100000:3.0:1790772148.550662:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412786176 00000100:00100000:3.0:1790772148.550744:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:3.0:1790772148.550766:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:0:x1877760412786176:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1790772148.551237:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1790772148.627241:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000001:00080000:2.0:1790772148.627261:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1790772148.627488:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:0:x1877760412786176:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 76726us (77060us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790772148.627502:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:0.0:1790772148.647632:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.647718:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412786432 00000100:00100000:3.0:1790772148.647731:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412786432 00000100:00100000:3.0:1790772148.647810:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:3.0:1790772148.647833:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:10443:x1877760412786432:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790772148.648146:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+31:10443:x1877760412786432:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 326us (522us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1790772148.648155:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:2.0:1790772148.652338:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.652892:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412786688 00000100:00100000:3.0:1790772148.652905:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412786688 00000100:00100000:3.0:1790772148.653078:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:3.0:1790772148.653092:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+31:10443:x1877760412786688:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790772148.653250:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+31:10443:x1877760412786688:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 160us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.653257:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:3.0:1790772148.655268:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.655349:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412786816 00000100:00100000:0.0:1790772148.655360:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412786816 00000100:00100000:0.0:1790772148.655428:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:0.0:1790772148.655438:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+31:10443:x1877760412786816:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772148.655461:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772148.655486:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9041d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ac1 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.655626:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.655666:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.655680:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772148.655735:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772148.655758:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.655789:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9041d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac1 expref: 33 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.655814:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac1 expref: 32 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.655838:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df254043800) 00010000:00010000:0.0:1790772148.655842:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790772148.655846:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9e00, rc 0) 00000100:00100000:0.0:1790772148.655918:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:10443:x1877760412786816:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 482us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772148.655926:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:0.0:1790772148.659154:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.659660:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412786944 00000100:00100000:3.0:1790772148.659673:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412786944 00000100:00100000:3.0:1790772148.659754:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:3.0:1790772148.659766:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412786944:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772148.659791:0:8509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772148.659816:0:8509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9042b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ac8 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772148.659875:0:8509:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd03b3, blocks: 0x1 00010000:00010000:3.0:1790772148.659901:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:3.0:1790772148.659906:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772148.659916:0:8509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9042b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac8 expref: 6 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.659940:0:8509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9042b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac8 expref: 6 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.659955:0:8509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2e00, rc 0) 00000100:00100000:3.0:1790772148.660769:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412786944:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 999us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.660779:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:0.0:1790772148.667481:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772148.667791:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412787200 00000100:00100000:2.0:1790772148.667804:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412787200 00000100:00100000:2.0:1790772148.667887:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:2.0:1790772148.667911:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:10443:x1877760412787200:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790772148.668068:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:10443:x1877760412787200:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 159us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772148.668077:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:2.0:1790772148.673344:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772148.673790:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412787328 00000100:00100000:2.0:1790772148.673804:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412787328 00000100:00100000:2.0:1790772148.673878:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:2.0:1790772148.673888:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:10443:x1877760412787328:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772148.673913:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772148.673939:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226acf expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.674151:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9042b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac8 expref: 7 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.674164:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772148.674169:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772148.674176:0:6678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.674219:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9042b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac8 expref: 7 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.674235:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9042b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac8 expref: 7 pid: 8509 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772148.674271:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1877760428539136:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772148.674381:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26f7679c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772148.680856:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.680895:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412787456 00000100:00100000:0.0:1790772148.680906:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412787456 00010000:00010000:0.0:1790772148.680956:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9042b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac8 expref: 8 pid: 8509 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772148.681027:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:0.0:1790772148.681036:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246096c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412787456:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772148.681055:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772148.681080:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9042b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac8 expref: 8 pid: 8509 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.681094:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9042b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac8 expref: 8 pid: 8509 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.681122:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772148.681126:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772148.681135:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.681145:0:5809:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.681189:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772148.681205:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5809:1877760428539264:192.168.206.27@tcp:105: 00000100:00100000:0.0:1790772148.681293:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1a80 going to sleep for 11 seconds 00010000:00010000:3.0:1790772148.683797:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9042b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac8 expref: 8 pid: 8509 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.684150:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1877760428539136:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772148.684189:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.684208:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9abe00, rc 0) 00000100:00100000:3.0:1790772148.684303:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:10443:x1877760412787328:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 10415us (10971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.684336:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:2.0:1790772148.686518:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5809:1877760428539264:192.168.206.27@tcp:105: 00010000:00010000:2.0:1790772148.686589:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772148.686661:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246096c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412787456:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 5624us (5815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772148.686673:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:0.0:1790772148.689084:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.689306:0:6684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412787584 00000100:00100000:3.0:1790772148.689319:0:6684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412787584 00002000:00100000:3.0:1790772148.689380:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8df2745a8a80 x1877760412787584/t0(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:494/0 lens 504/0 e 0 to 0 dl 1790772159 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790772148.689394:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2745a8a80 with x1877760412787584 ext(0->8) 00002000:00010000:3.0:1790772148.689401:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2745a8a80 00000100:00100000:3.0:1790772148.689445:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:3.0:1790772148.689456:0:6684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412787584:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790772148.691443:0:6684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412787584:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 Request processed in 1982us (2365us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790772148.691457:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00002000:00100000:3.0:1790772148.691469:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8df2745a8a80 x1877760412787584/t4294967302(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:494/0 lens 504/448 e 0 to 0 dl 1790772159 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790772148.691479:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2745a8a80 with x1877760412787584 ext(0->8) 00002000:00010000:3.0:1790772148.691485:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2745a8a80 00000100:00100000:2.0:1790772148.707198:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.712332:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412787712 00000100:00100000:0.0:1790772148.712358:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412787712 00000100:00100000:0.0:1790772148.712433:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:0.0:1790772148.712444:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:10443:x1877760412787712:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790772148.806077:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:10443:x1877760412787712:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 Request processed in 93621us (98876us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772148.806094:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 80 00000001:00080000:0.0:1790772148.806154:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:0.0:1790772148.806176:0:5845:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1790772148.806196:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:0.0:1790772148.806207:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1790772148.806212:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1790772148.806236:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:0.0:1790772148.806747:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428539392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790772148.806810:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772148.806885:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428539392 00000100:00100000:0.0:1790772148.806895:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428539392 00000100:00100000:0.0:1790772148.806945:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772148.806954:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428539392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790772148.807144:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790772148.807148:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790772148 00002000:00010000:0.0:1790772148.807151:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790772148.807153:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790772147 -> 1790772148 00002000:00010000:0.0:1790772148.807155:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790772148.807197:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1877760428539392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (386us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790772148.807206:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1790772148.807260:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df2745a8380/2, rc 0, transno 4294967303 00000100:00100000:0.0:1790772148.807276:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428539392:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1790772148.807331:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1790772148.807346:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1790772148.811254:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.813091:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412787840 00000100:00100000:3.0:1790772148.813112:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412787840 00000100:00100000:3.0:1790772148.813196:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00100000:3.0:1790772148.813208:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412787840:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790772148.845281:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412787840:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 Request processed in 32060us (34021us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.845319:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 30 00000001:00080000:2.0:1790772148.845448:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1790772148.845464:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1790772148.848585:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.850507:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412788096 00000100:00100000:3.0:1790772148.850532:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412788096 00000100:00100000:3.0:1790772148.850663:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 81 00000100:00100000:3.0:1790772148.850676:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:10443:x1877760412788096:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790772148.850780:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772148.850827:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a90424 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ac1 expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.850861:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df254043800) 00010000:00010000:3.0:1790772148.850867:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772148.850908:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.850925:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.850936:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772148.851430:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b00ab764 reply state 0000000003fa403a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.851443:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772148.851766:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10443:x1877760412788096:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1090us (3229us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790772148.851776:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 81 00010000:00010000:1.0:1790772148.854292:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.854315:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.854324:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.854330:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772148.854336:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.854344:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.854363:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df254043800) 00010000:00010000:1.0:1790772148.854367:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772148.854392:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.854399:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90439 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772148.860500:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.860628:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412788224 00000100:00100000:0.0:1790772148.860641:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412788224 00000100:00100000:0.0:1790772148.860722:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:0.0:1790772148.860733:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412788224:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790772148.861075:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790772148.861080:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790772148 -> 1790772147 00002000:00010000:0.0:1790772148.861083:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790772145 00002000:00010000:0.0:1790772148.861085:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790772148 -> 1790772147 00002000:00010000:0.0:1790772148.861088:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790772148.861169:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412788224:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 437us (680us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790772148.861177:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:0.0:1790772148.864373:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772148.864493:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412788480 00000100:00100000:2.0:1790772148.864507:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412788480 00000100:00100000:3.0:1790772148.864798:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:3.0:1790772148.864830:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:10443:x1877760412788480:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790772148.864934:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.864955:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ab3 expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.864966:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.865020:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ab3 expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.865036:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ab3 expref: 13 pid: 6701 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.865052:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428539520:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772148.865163:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772148.868268:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428539520:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772148.868309:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772148.868496:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.869925:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412788608 00000100:00100000:3.0:1790772148.869939:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412788608 00010000:00010000:3.0:1790772148.869997:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ab3 expref: 14 pid: 6701 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.870048:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:3.0:1790772148.870076:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:2347:x1877760412788608:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772148.870095:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772148.870103:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ab3 expref: 14 pid: 6701 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870119:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ab3 expref: 14 pid: 6701 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870147:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ab3 expref: 14 pid: 6701 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870168:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df254043800) 00010000:00010000:3.0:1790772148.870173:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870184:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870205:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870237:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772148.870305:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:2347:x1877760412788608:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 230us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.870314:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00010000:00010000:3.0:1790772148.870345:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870353:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870393:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870401:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870408:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870415:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772148.870421:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870429:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870438:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df254043800) 00010000:00010000:3.0:1790772148.870441:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790772148.870445:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.870451:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90440 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.870496:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+12:10443:x1877760412788480:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 Request processed in 5669us (6137us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790772148.870506:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:0.0:1790772148.877882:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.877989:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412788736 00000100:00100000:3.0:1790772148.878002:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412788736 00000100:00100000:3.0:1790772148.878070:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:3.0:1790772148.878092:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412788736:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790772148.878148:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.878174:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.878184:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790772148.878190:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772148.878195:0:6678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.878239:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.878256:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 7 pid: 6678 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.878274:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1877760428539648:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772148.878380:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772148.881435:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.881475:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412788864 00000100:00100000:3.0:1790772148.881486:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412788864 00010000:00010000:3.0:1790772148.881537:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 8 pid: 6678 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.881606:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:3.0:1790772148.881633:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412788864:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772148.881652:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772148.881680:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 8 pid: 6678 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.881708:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 8 pid: 6678 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.881741:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772148.881746:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772148.881754:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.882116:0:5808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.882144:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772148.882222:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412788864:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 589us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.882230:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00010000:00010000:0.0:1790772148.886398:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb60374e/0xdf68d9a7d6a90432 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226acf expref: 7 pid: 6678 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772148.886430:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1877760428539648:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772148.886465:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.886479:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.886487:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.886564:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.886574:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.886582:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.886591:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772148.886596:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.886605:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.886629:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772148.886637:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a90447 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772148.886746:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412788736:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 Request processed in 8656us (8878us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.889494:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772148.889623:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:2.0:1790772148.893091:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412789120 00000100:00100000:2.0:1790772148.893111:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412789120 00000100:00100000:2.0:1790772148.893238:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 83 00000100:00100000:2.0:1790772148.893252:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+12:10443:x1877760412789120:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790772148.893356:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9044e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.893378:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9044e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.893392:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9044e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.893706:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.893720:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9040f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aba expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.893730:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.893786:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9040f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aba expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.893802:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9040f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aba expref: 13 pid: 6701 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772148.893820:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b283100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428539776:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772148.893939:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927b000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772148.903772:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.903867:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412789248 00000100:00100000:3.0:1790772148.903879:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412789248 00010000:00010000:3.0:1790772148.903932:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9040f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aba expref: 14 pid: 6701 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.903993:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:3.0:1790772148.904017:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:2348:x1877760412789248:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772148.904036:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772148.904044:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9040f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aba expref: 14 pid: 6701 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.904059:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9040f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aba expref: 14 pid: 6701 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.904084:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df254043800) 00010000:00010000:3.0:1790772148.904091:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.904102:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.904110:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.904131:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772148.904193:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:2348:x1877760412789248:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 178us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.904201:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00010000:00010000:1.0:1790772148.905380:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9040f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aba expref: 13 pid: 6701 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772148.905406:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b283100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428539776:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772148.905434:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.905446:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.905452:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772148.905680:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1790772148.906045:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1790772148.906102:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1790772148.906204:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27478f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877760428539904:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790772148.906305:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772148.906360:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfad80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772148.906515:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428539904 00000100:00100000:3.0:1790772148.906524:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428539904 00000100:00100000:3.0:1790772148.906609:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790772148.906620:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1877760428539904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790772148.906720:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1877760428539904:12345-0@lo:1000:mdt00_000.0 Request processed in 102us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.906729:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772148.907200:0:5823:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1790772148.907206:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df2745a8380, transno 4294967303 00000100:00100000:1.0:1790772148.907262:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27478f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877760428539904:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1790772148.907836:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1790772148.907918:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27478f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877760428540032:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790772148.908090:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772148.908125:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772148.908254:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428540032 00000100:00100000:3.0:1790772148.908263:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428540032 00000100:00100000:3.0:1790772148.908317:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772148.908326:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1877760428540032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790772148.908580:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5823:x1877760428540032:12345-0@lo:1000:mdt00_000.0 Request processed in 255us (492us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790772148.908588:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772148.910206:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27478f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877760428540032:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790772148.910265:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910278:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910288:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910295:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772148.910301:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910311:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910330:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df254043800) 00010000:00010000:1.0:1790772148.910334:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772148.910340:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910346:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90455 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910392:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9038a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910399:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9038a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910414:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9038a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910419:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772148.910423:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9038a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910429:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9038a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910437:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df254043000) 00010000:00010000:1.0:1790772148.910440:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772148.910443:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9038a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910449:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a9038a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910478:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910497:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a9e expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910506:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910580:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a9e expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772148.910611:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a9e expref: 16 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772148.910629:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27478c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428540160:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772148.910738:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa600 going to sleep for 11 seconds 00000100:00100000:1.0:1790772148.914459:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772148.914856:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412789376 00000100:00100000:3.0:1790772148.914869:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412789376 00010000:00010000:3.0:1790772148.914923:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a9e expref: 17 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.915039:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:3.0:1790772148.915053:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:2347:x1877760412789376:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772148.915072:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772148.915080:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a9e expref: 17 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.915097:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a9e expref: 17 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.915123:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df254043000) 00010000:00010000:3.0:1790772148.915129:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.915141:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.915150:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.915182:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772148.916144:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:2347:x1877760412789376:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 1086us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772148.916156:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 46 00010000:00010000:3.0:1790772148.917657:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a903a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a9e expref: 16 pid: 5825 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.917687:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27478c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428540160:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772148.917724:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917735:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917742:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917758:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917766:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917775:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917781:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772148.917786:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917807:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917825:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df254043000) 00010000:00010000:3.0:1790772148.917828:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772148.917834:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917841:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9045c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917853:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9044e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917859:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9044e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917865:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9044e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917871:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aba00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772148.917874:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9044e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917880:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9044e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917887:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df254043000) 00010000:00010000:3.0:1790772148.917889:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790772148.917892:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9044e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772148.917906:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a9044e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772148.918177:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:10443:x1877760412789120:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 24926us (28693us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1790772148.918188:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 83 00000020:00080000:3.0:1790772148.918194:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790772148.925355:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772148.925369:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772148.925413:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790772148.925420:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790772148.926771:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772148.926851:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412789632 00000100:00100000:2.0:1790772148.926863:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412789632 00000100:00100000:2.0:1790772148.926930:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:2.0:1790772148.926942:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:10443:x1877760412789632:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790772148.927795:0:5826:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790772148.927932:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1790772148.928002:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928025:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928040:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928049:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928056:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928063:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928090:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790772148.928210:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:10443:x1877760412789632:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 1268us (1457us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1790772148.928222:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00000020:00080000:2.0:1790772148.928228:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790772148.928268:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772148.928276:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928283:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772148.928287:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928296:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928317:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df25a490700) 00010000:00010000:2.0:1790772148.928320:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790772148.928325:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928331:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90463 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772148.928351:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772148.928353:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772148.928354:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790772149.101475:0:11983:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790772149.101488:0:11983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772149.101546:0:11983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790772149.101579:0:11983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790772149.282225:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772149.288483:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.288592:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412789888 00000100:00100000:0.0:1790772149.288601:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412789888 00000100:00080000:2.0:1790772149.288633:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772149.288665:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:0.0:1790772149.288676:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:10453:x1877760412789888:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772149.288711:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772149.288730:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9046a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ad6 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.288822:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90471 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.288838:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90471 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.288848:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90471 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772149.288859:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790772149.288971:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9046a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ad6 expref: 20 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.288989:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90471 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ad6 expref: 19 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.288997:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772149.289000:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790772149.289003:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8e00, rc 0) 00000100:00100000:0.0:1790772149.289614:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10453:x1877760412789888:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 937us (1137us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1790772149.289630:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:2.0:1790772149.293665:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772149.293734:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412790016 00000100:00100000:3.0:1790772149.293743:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412790016 00000100:00100000:3.0:1790772149.293802:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:3.0:1790772149.293811:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10453:x1877760412790016:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:3.0:1790772149.293881:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9047f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.293897:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9047f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.293921:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9047f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.293936:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.293943:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.293948:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294830:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294841:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294848:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772149.294889:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294902:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9047f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294909:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9047f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294916:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9047f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294922:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.294926:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9047f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294933:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9047f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294944:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:3.0:1790772149.294947:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772149.294951:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9047f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294964:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9047f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294976:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294982:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90486 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294988:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.294992:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.294995:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.295001:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90486 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.295008:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df247e07100) 00010000:00010000:3.0:1790772149.295011:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772149.295026:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90486 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.295033:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90486 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.295049:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.295055:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.295067:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.295073:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.295076:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.295081:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.295088:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:3.0:1790772149.295091:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772149.295093:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.295099:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9048d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772149.295315:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10453:x1877760412790016:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 1367us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772149.295325:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:2.0:1790772149.347659:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772149.347756:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412790272 00000100:00100000:3.0:1790772149.347766:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412790272 00000100:00100000:3.0:1790772149.347834:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:3.0:1790772149.347845:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10456:x1877760412790272:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772149.347865:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772149.347884:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90494 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226add expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.347963:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9049b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.347977:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9049b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.347988:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9049b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348003:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348011:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348018:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348250:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348259:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348266:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772149.348275:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790772149.348343:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9049b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348362:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9049b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348374:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9049b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348379:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.348384:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9049b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348393:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9049b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348404:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:3.0:1790772149.348407:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772149.348411:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9049b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348418:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9049b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348430:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348436:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348442:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348447:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.348450:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348464:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348471:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df247e07a00) 00010000:00010000:3.0:1790772149.348473:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772149.348476:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348481:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348515:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90494 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226add expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348527:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226add expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.348534:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:3.0:1790772149.348537:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772149.348539:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3200, rc 0) 00000100:00100000:3.0:1790772149.348644:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10456:x1877760412790272:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 801us (991us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1790772149.348651:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:2.0:1790772149.354132:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.354249:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412790400 00000100:00100000:0.0:1790772149.354259:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412790400 00000100:00100000:0.0:1790772149.354317:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 87 00000100:00100000:0.0:1790772149.354328:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10456:x1877760412790400:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1790772149.354404:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.354421:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.354432:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.354458:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.354465:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.354473:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.354480:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772149.354484:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.354491:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.354502:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:0.0:1790772149.354518:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772149.354524:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.354530:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772149.354652:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10456:x1877760412790400:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 326us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772149.354660:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 87 00000100:00100000:1.0:1790772149.362639:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772149.362909:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412790656 00000100:00100000:2.0:1790772149.362918:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412790656 00000100:00100000:2.0:1790772149.363086:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:2.0:1790772149.363097:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25dbd1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10456:x1877760412790656:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1790772149.363312:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25dbd1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:10456:x1877760412790656:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 216us (679us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1790772149.363320:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:1.0:1790772149.399076:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772149.399237:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412790912 00000100:00100000:3.0:1790772149.399247:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412790912 00000100:00100000:3.0:1790772149.399368:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 88 00000100:00100000:3.0:1790772149.399378:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:9984:x1877760412790912:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1790772149.399416:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772149.399435:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a904be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ae4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.399522:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.399537:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226add expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.399545:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.399615:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226add expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.399639:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226add expref: 23 pid: 5824 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772149.399652:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428540288:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772149.399736:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772149.402432:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772149.402637:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412791040 00000100:00100000:3.0:1790772149.402646:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412791040 00010000:00010000:3.0:1790772149.402681:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226add expref: 24 pid: 5824 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772149.402734:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:3.0:1790772149.402743:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:2348:x1877760412791040:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772149.402773:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772149.402780:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226add expref: 24 pid: 5824 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.402793:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226add expref: 24 pid: 5824 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.402813:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:3.0:1790772149.402818:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.402828:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.402836:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.402853:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772149.402906:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:2348:x1877760412791040:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 163us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772149.402913:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00010000:00010000:0.0:1790772149.403422:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a904a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226add expref: 23 pid: 5824 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772149.403438:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428540288:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772149.403455:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.403464:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.403470:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772149.403488:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790772149.403674:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a904be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ae4 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.403689:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ae4 expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.403723:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:0.0:1790772149.403726:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790772149.403729:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3400, rc 0) 00000100:00100000:0.0:1790772149.403765:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:9984:x1877760412790912:12345-192.168.206.27@tcp:101:bash.0 Request processed in 4389us (4708us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1790772149.403772:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 88 00000100:00100000:1.0:1790772149.409245:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.409414:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412791296 00000100:00100000:0.0:1790772149.409424:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412791296 00000100:00100000:0.0:1790772149.409482:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:0.0:1790772149.409491:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:9984:x1877760412791296:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:0.0:1790772149.409877:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.409893:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.409903:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772149.409955:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1790772149.410142:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c6d8fc43 reply state 0000000040a80960 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772149.410152:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790772149.410201:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1790772149.410342:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:9984:x1877760412791296:12345-192.168.206.27@tcp:36:bash.0 Request processed in 850us (1104us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1790772149.410350:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 89 00000020:00080000:0.0:1790772149.410364:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1790772149.413922:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772149.413938:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772149.413946:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772149.413952:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772149.413957:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772149.413993:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772149.414008:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:1.0:1790772149.414012:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772149.414016:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772149.414022:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a904d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772149.416054:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.416143:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412791424 00000100:00100000:0.0:1790772149.416153:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412791424 00000100:00100000:0.0:1790772149.416207:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:0.0:1790772149.416217:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:9984:x1877760412791424:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1790772149.416241:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772149.416258:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a904da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226aeb expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.416314:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a904da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aeb expref: 27 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.416328:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a904da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aeb expref: 27 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.416348:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:0.0:1790772149.416351:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772149.416354:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9e00, rc 0) 00000100:00100000:0.0:1790772149.416416:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:9984:x1877760412791424:12345-192.168.206.27@tcp:101:bash.0 Request processed in 200us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772149.416423:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:3.0:1790772149.419350:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772149.419431:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412791552 00000100:00100000:1.0:1790772149.419440:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412791552 00000100:00100000:1.0:1790772149.419490:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:1.0:1790772149.419500:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:9984:x1877760412791552:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1790772149.419516:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772149.419538:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a904e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226af2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772149.419579:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abd03b3, atime: 0x6abd03b1, ctime: 0x6abd03b3, blocks: 0xb 00010000:00010000:1.0:1790772149.419668:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1790772149.419673:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772149.419681:0:6679:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a904e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af2 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772149.419708:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a904e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af2 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772149.419731:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9c00, rc 0) 00000100:00100000:1.0:1790772149.419788:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:9984:x1877760412791552:12345-192.168.206.27@tcp:101:bash.0 Request processed in 289us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772149.419794:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:1.0:1790772149.424096:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772149.424703:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412791680 00000100:00100000:2.0:1790772149.424713:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412791680 00002000:00010000:2.0:1790772149.424760:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1790772149.424765:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27abec700 with x1877760412791680 ext(0->18446744073709551615) 00002000:00010000:2.0:1790772149.424776:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27abec700. 00000100:00100000:2.0:1790772149.424814:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:2.0:1790772149.424839:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2349:x1877760412791680:12345-192.168.206.27@tcp:10:bash.0 00002000:00010000:2.0:1790772149.425364:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790772149.425368:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790772147 -> 1790772148 00002000:00010000:2.0:1790772149.425370:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1790772145 -> 1790772145 00002000:00010000:2.0:1790772149.425372:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790772147 -> 1790772148 00002000:00010000:2.0:1790772149.425374:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790772149.425436:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2349:x1877760412791680:12345-192.168.206.27@tcp:10:bash.0 Request processed in 603us (1348us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790772149.425444:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00002000:00010000:2.0:1790772149.425448:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1790772149.425451:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27abec700 with x1877760412791680 ext(0->18446744073709551615) 00002000:00010000:2.0:1790772149.425455:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27abec700. 00000100:00100000:2.0:1790772149.536259:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772149.536311:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412791808 00000100:00100000:3.0:1790772149.536321:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412791808 00000100:00100000:3.0:1790772149.536494:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 91 00000100:00100000:3.0:1790772149.536504:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10470:x1877760412791808:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:3.0:1790772149.536611:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a904e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.536645:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a904e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.536655:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a904e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.536671:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a904ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.536678:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a904ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.536683:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a904ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.536916:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.536925:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.536932:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772149.536980:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.536991:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a904e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.536997:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a904e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537013:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a904e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537019:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.537023:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a904e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537032:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a904e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537048:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:3.0:1790772149.537051:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772149.537055:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a904e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537062:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a904e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537075:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a904ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537085:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a904ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537090:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a904ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537096:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.537098:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a904ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537114:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a904ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537122:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df247e07a00) 00010000:00010000:3.0:1790772149.537124:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772149.537127:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a904ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537132:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a904ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537466:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537473:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537479:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537484:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.537487:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537493:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537502:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:3.0:1790772149.537504:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772149.537507:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.537615:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a904f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772149.537746:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10470:x1877760412791808:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 1241us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772149.537754:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 91 00000100:00100000:3.0:1790772149.591538:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.592142:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412792064 00000100:00100000:0.0:1790772149.592153:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412792064 00000100:00100000:0.0:1790772149.592210:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 92 00000100:00100000:0.0:1790772149.592221:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10473:x1877760412792064:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772149.592240:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772149.592260:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a904fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226af9 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592342:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90504 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592357:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592368:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592382:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9050b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592389:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9050b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592395:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9050b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592644:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592654:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592662:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772149.592672:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790772149.592777:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592786:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90504 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592799:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90504 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592805:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772149.592809:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90504 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592816:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90504 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592826:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772149.592829:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772149.592833:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90504 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592840:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90504 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592852:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9050b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592858:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9050b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592863:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9050b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592868:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772149.592870:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9050b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592886:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9050b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592895:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df254043700) 00010000:00010000:0.0:1790772149.592897:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772149.592900:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9050b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592907:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9050b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592946:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a904fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af9 expref: 30 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592960:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af9 expref: 29 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.592967:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:0.0:1790772149.594185:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790772149.594191:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9000, rc 0) 00000100:00100000:0.0:1790772149.594311:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:10473:x1877760412792064:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 2090us (2778us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1790772149.594320:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 92 00000100:00100000:1.0:1790772149.602931:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.603024:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412792192 00000100:00100000:0.0:1790772149.603033:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412792192 00000100:00100000:0.0:1790772149.603085:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:0.0:1790772149.603094:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:10473:x1877760412792192:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1790772149.603165:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.603183:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ae4 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.603193:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.603222:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ae4 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.603236:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ae4 expref: 29 pid: 5824 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772149.603249:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27fcab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428540416:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772149.603337:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142accd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772149.605635:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27fcab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428540416:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772149.605659:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772149.607634:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.607728:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412792448 00000100:00100000:0.0:1790772149.607737:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412792448 00000100:00100000:0.0:1790772149.607797:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:0.0:1790772149.607807:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:5587:x1877760412792448:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790772149.608104:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+31:5587:x1877760412792448:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 297us (476us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1790772149.608244:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:1.0:1790772149.612352:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772149.612443:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412792576 00000100:00100000:2.0:1790772149.612452:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412792576 00010000:00010000:2.0:1790772149.612498:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ae4 expref: 31 pid: 5824 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772149.612538:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:2.0:1790772149.612546:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+31:2348:x1877760412792576:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772149.612583:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772149.612589:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ae4 expref: 31 pid: 5824 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.612603:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ae4 expref: 31 pid: 5824 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.612641:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a904c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ae4 expref: 31 pid: 5824 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.612655:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:2.0:1790772149.612660:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.612670:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.612677:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.612718:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772149.612905:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:2348:x1877760412792576:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 358us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772149.612913:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 48 00010000:00010000:0.0:1790772149.613350:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.613359:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.613387:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.613395:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.613402:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.613408:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772149.613412:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.613419:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.613429:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:0.0:1790772149.613432:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772149.613436:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.613442:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90520 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772149.613546:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:10473:x1877760412792192:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 10453us (10620us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772149.613605:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:1.0:1790772149.619005:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772149.619069:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412792832 00000100:00100000:2.0:1790772149.619078:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412792832 00000100:00100000:2.0:1790772149.619135:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:2.0:1790772149.619144:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:10473:x1877760412792832:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1790772149.619356:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:10473:x1877760412792832:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 212us (358us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1790772149.619364:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:3.0:1790772149.756653:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.756920:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412793088 00000100:00100000:0.0:1790772149.756930:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412793088 00000100:00100000:0.0:1790772149.757007:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:0.0:1790772149.757018:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:10484:x1877760412793088:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:0.0:1790772149.757040:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772149.757059:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90527 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b00 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757125:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9052e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757140:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9052e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757150:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9052e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757164:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757171:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757178:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757427:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9053c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757448:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9053c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757455:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9053c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772149.757465:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1790772149.757583:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9052e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757592:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9052e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757599:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9052e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757604:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772149.757609:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9052e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757615:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9052e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757627:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772149.757629:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772149.757634:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9052e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757640:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9052e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757653:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757665:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90535 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757671:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757697:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772149.757701:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757708:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90535 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757717:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df254043700) 00010000:00010000:0.0:1790772149.757719:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772149.757722:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90535 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757728:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757781:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90527 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b00 expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757795:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9053c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b00 expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.757802:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:0.0:1790772149.757805:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772149.757814:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9600, rc 0) 00000100:00100000:0.0:1790772149.757882:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:10484:x1877760412793088:12345-192.168.206.27@tcp:101:cat.0 Request processed in 866us (1237us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1790772149.757889:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:1.0:1790772149.762285:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772149.762371:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412793344 00000100:00100000:3.0:1790772149.762381:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412793344 00000100:00100000:3.0:1790772149.762437:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:3.0:1790772149.762446:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:10484:x1877760412793344:12345-192.168.206.27@tcp:35:cat.0 00000100:00100000:3.0:1790772149.762715:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:10484:x1877760412793344:12345-192.168.206.27@tcp:35:cat.0 Request processed in 269us (437us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790772149.762723:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:1.0:1790772149.818836:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772149.820086:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412793600 00000100:00100000:3.0:1790772149.820099:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412793600 00000100:00100000:3.0:1790772149.820176:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 95 00000100:00100000:3.0:1790772149.820186:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:10485:x1877760412793600:12345-192.168.206.27@tcp:36:rm.0 00010000:00010000:3.0:1790772149.820243:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790772149.820269:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9053c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b00 expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.820297:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af9 expref: 32 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.820332:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a904da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226aeb expref: 31 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.820342:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07100) 00010000:00010000:3.0:1790772149.820351:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772149.820370:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a9054a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.820382:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a9054a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.820390:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a9054a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.820403:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.820410:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.820418:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.821293:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90558 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.821305:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.821312:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772149.821891:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1790772149.821901:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315966351002ns, next at 316966348646ns, rc = 0 00010000:00010000:3.0:1790772149.821956:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.821978:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.821987:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.821994:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.822000:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.822007:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826478:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772149.826520:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826532:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90558 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826539:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90558 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826544:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.826580:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90558 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826588:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90558 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826602:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07300) 00010000:00010000:3.0:1790772149.826605:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790772149.826609:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90558 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826615:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90558 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826638:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a9054a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826644:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a9054a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826649:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a9054a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826655:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.826657:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a9054a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826663:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a9054a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826670:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:3.0:1790772149.826672:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772149.826681:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a9054a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.826688:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a9054a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772149.826712:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006bcd7e31 reply state 000000008cff3deb transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772149.826721:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772149.826827:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:10485:x1877760412793600:12345-192.168.206.27@tcp:36:rm.0 Request processed in 6639us (7995us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1790772149.826836:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 95 00010000:00010000:3.0:1790772149.829308:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.829323:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.829330:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.829336:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772149.829340:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.829348:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.829362:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df247e07a00) 00010000:00010000:3.0:1790772149.829364:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772149.829368:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772149.829386:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90551 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.830060:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772149.830068:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.830076:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772149.830080:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.830088:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.830100:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8df247e07300) 00010000:00010000:0.0:1790772149.830103:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790772149.830106:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.830111:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9055f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.830127:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772149.830129:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772149.830130:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772149.875892:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.875995:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412793856 00000100:00100000:0.0:1790772149.876005:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412793856 00000100:00100000:0.0:1790772149.876062:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 96 00000100:00100000:0.0:1790772149.876072:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+31:10491:x1877760412793856:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1790772149.876094:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772149.876126:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90566 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b07 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.876232:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9056d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.876246:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9056d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.876258:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9056d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.876272:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.876279:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.876285:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772149.876867:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1790772149.877023:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877033:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877041:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877072:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9056d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877089:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9056d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877096:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9056d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877101:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772149.877106:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9056d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877113:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9056d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877124:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772149.877127:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772149.877131:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9056d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877136:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9056d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772149.877150:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006968a390 reply state 000000001737cd49 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772149.877159:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790772149.877185:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90566 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b07 expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877199:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b07 expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.877219:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043400) 00010000:00010000:0.0:1790772149.877221:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772149.877224:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9a00, rc 0) 00000100:00100000:0.0:1790772149.877283:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+34:10491:x1877760412793856:12345-192.168.206.27@tcp:101:bash.0 Request processed in 1212us (1399us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790772149.877291:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 96 00010000:00010000:2.0:1790772149.880100:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.880117:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.880152:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.880159:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772149.880163:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.880172:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.880186:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df254043700) 00010000:00010000:2.0:1790772149.880189:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772149.880193:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.880199:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90574 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772149.883357:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.883435:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412793984 00000100:00100000:0.0:1790772149.883444:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412793984 00000100:00100000:0.0:1790772149.883509:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:0.0:1790772149.883518:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412793984:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1790772149.883535:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772149.883590:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90589 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b0e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772149.883616:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790772149.883634:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1790772149.883638:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772149.883647:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90589 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b0e expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.883665:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90589 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b0e expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.883677:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8200, rc 0) 00000100:00100000:0.0:1790772149.883735:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412793984:12345-192.168.206.27@tcp:101:bash.0 Request processed in 218us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772149.883767:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00080000:2.0:1790772149.883900:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772149.902476:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772149.903388:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412794112 00000100:00100000:0.0:1790772149.903401:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412794112 00000100:00100000:0.0:1790772149.903525:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:0.0:1790772149.903536:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:10491:x1877760412794112:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1790772149.903585:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772149.903604:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b15 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.903635:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90589 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b0e expref: 9 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.903657:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772149.903662:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772149.903667:0:6679:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.903711:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90589 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b0e expref: 9 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.903725:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90589 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b0e expref: 9 pid: 6677 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772149.903739:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27fcab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1877760428540544:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772149.903865:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acce40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772149.911259:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772149.911598:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412794240 00000100:00100000:2.0:1790772149.911608:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412794240 00010000:00010000:2.0:1790772149.911649:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90589 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b0e expref: 10 pid: 6677 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772149.911701:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:2.0:1790772149.911712:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246094450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:2348:x1877760412794240:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772149.911728:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772149.911750:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90589 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b0e expref: 10 pid: 6677 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.911776:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90589 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b0e expref: 10 pid: 6677 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.911799:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772149.911803:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772149.911812:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.911823:0:5810:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772149.911859:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772149.911875:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b281180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5810:1877760428540672:192.168.206.27@tcp:105: 00000100:00100000:2.0:1790772149.911959:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927b9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790772149.912165:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90589 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b0e expref: 10 pid: 6677 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772149.912181:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27fcab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1877760428540544:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772149.912203:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772149.912215:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8c00, rc 0) 00000100:00100000:0.0:1790772149.912248:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:10491:x1877760412794112:12345-192.168.206.27@tcp:101:bash.0 Request processed in 8714us (9781us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772149.912255:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:1.0:1790772149.923825:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772149.923879:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412794496 00000100:00100000:3.0:1790772149.923890:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412794496 00000100:00100000:3.0:1790772149.923946:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:3.0:1790772149.923956:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:10491:x1877760412794496:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:3.0:1790772149.924349:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+34:10491:x1877760412794496:12345-192.168.206.27@tcp:35:bash.0 Request processed in 393us (530us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1790772149.924357:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:2.0:1790772149.925082:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b281180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5810:1877760428540672:192.168.206.27@tcp:105: 00010000:00010000:2.0:1790772149.925103:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772149.925197:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246094450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412794240:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 13485us (13946us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772149.925206:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:1.0:1790772150.106595:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.106746:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412794624 00000100:00100000:0.0:1790772150.106765:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412794624 00000100:00100000:0.0:1790772150.106823:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 97 00000100:00100000:0.0:1790772150.106833:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+34:10507:x1877760412794624:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772150.106857:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772150.106876:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.106939:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9059e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.106954:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9059e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.107083:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9059e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772150.107144:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790772150.107149:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772150.107167:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9059e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.107309:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b1c expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.107330:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9059e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b1c expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.107339:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772150.107342:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772150.107346:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9e00, rc 0) 00000100:00100000:0.0:1790772150.107509:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:10507:x1877760412794624:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 676us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772150.107516:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 97 00000100:00100000:1.0:1790772150.112212:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.112357:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412794880 00000100:00100000:0.0:1790772150.112368:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412794880 00000100:00100000:0.0:1790772150.112462:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 98 00000100:00100000:0.0:1790772150.112472:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:10507:x1877760412794880:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772150.112491:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772150.112509:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b23 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.112621:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a905ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.112648:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a905ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.112658:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a905ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772150.112670:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790772150.112812:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b23 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.112833:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a905ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b23 expref: 37 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.112842:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043400) 00010000:00010000:0.0:1790772150.112845:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772150.112848:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9600, rc 0) 00000100:00100000:0.0:1790772150.112908:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+37:10507:x1877760412794880:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 437us (704us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1790772150.112915:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 98 00000100:00100000:2.0:1790772150.116821:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772150.116856:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.116924:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412795264 00000100:00100000:3.0:1790772150.116933:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412795264 00000100:00100000:3.0:1790772150.117000:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:3.0:1790772150.117010:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+37:2350:x1877760412795264:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772150.117024:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772150.117046:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a905ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b23 expref: 37 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.117067:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043400) 00010000:00010000:3.0:1790772150.117072:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772150.117129:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:2350:x1877760412795264:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 108us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772150.117137:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1790772150.117611:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412795136 00000100:00100000:1.0:1790772150.117617:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412795136 00000100:00100000:1.0:1790772150.117654:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:1.0:1790772150.117662:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:10507:x1877760412795136:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772150.117680:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772150.117703:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a905ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b2a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772150.118807:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a905c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772150.118825:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a905c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772150.118836:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a905c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772150.118848:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790772150.119070:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a905ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b2a expref: 39 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772150.119092:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a905c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b2a expref: 38 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772150.119101:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043400) 00010000:00010000:1.0:1790772150.119104:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790772150.119107:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9800, rc 0) 00000100:00100000:1.0:1790772150.119417:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+38:10507:x1877760412795136:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1753us (2602us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1790772150.119426:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:0.0:1790772150.128460:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.128526:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412795392 00000100:00100000:3.0:1790772150.128536:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412795392 00000100:00100000:3.0:1790772150.128611:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:3.0:1790772150.128634:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412795392:12345-192.168.206.27@tcp:1:lfs.0 00010000:00010000:3.0:1790772150.128675:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.128705:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.128714:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772150.128718:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772150.128723:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.128756:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.128771:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 8 pid: 6679 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772150.128785:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1877760428540800:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772150.128950:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bb900 going to sleep for 11 seconds 00000100:00100000:2.0:1790772150.132274:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.132356:0:6684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412795520 00000100:00100000:0.0:1790772150.132364:0:6684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412795520 00002000:00100000:0.0:1790772150.132410:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8df27b283100 x1877760412795520/t0(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:496/0 lens 504/0 e 0 to 0 dl 1790772161 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790772150.132421:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27b283100 with x1877760412795520 ext(0->8) 00010000:00010000:0.0:1790772150.132429:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 9 pid: 6679 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.132458:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 9 pid: 6679 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772150.132466:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df27b283100 00000100:00100000:0.0:1790772150.132499:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:0.0:1790772150.132508:0:6684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2348:x1877760412795520:12345-192.168.206.27@tcp:4:lfs.0 00000100:00100000:0.0:1790772150.132998:0:6684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:2348:x1877760412795520:12345-192.168.206.27@tcp:4:lfs.0 Request processed in 490us (731us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790772150.133007:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00002000:00100000:0.0:1790772150.133014:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8df27b283100 x1877760412795520/t4294967302(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:496/0 lens 504/448 e 0 to 0 dl 1790772161 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790772150.133024:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27b283100 with x1877760412795520 ext(0->8) 00010000:00010000:0.0:1790772150.133030:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 11 pid: 6679 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.133043:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 11 pid: 6679 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772150.133051:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df27b283100 00000100:00100000:3.0:1790772150.135902:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1877760428540800:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772150.135927:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772150.136349:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.136434:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412795648 00000100:00100000:3.0:1790772150.136440:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412795648 00010000:00010000:3.0:1790772150.136485:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 11 pid: 6679 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772150.136581:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:3.0:1790772150.136591:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:2347:x1877760412795648:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772150.136606:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790772150.136624:0:7617:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790772150.136627:0:7617:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790772149 00002000:00010000:3.0:1790772150.136629:0:7617:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790772149 00002000:00010000:3.0:1790772150.136632:0:7617:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790772149 00010000:00010000:3.0:1790772150.136638:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 11 pid: 6679 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.136651:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 11 pid: 6679 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.136671:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a90590 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b15 expref: 11 pid: 6679 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.136686:0:7617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772150.136701:0:7617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772150.136707:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.136718:0:7617:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.136754:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772150.136803:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:2347:x1877760412795648:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 214us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772150.136810:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 50 00010000:00010000:0.0:1790772150.136881:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.136891:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.136925:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.136934:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.136943:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.136950:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2e00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772150.136954:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.136963:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.136986:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.136994:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a905cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772150.137038:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2347:x1877760412795392:12345-192.168.206.27@tcp:1:lfs.0 Request processed in 8408us (8587us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772150.137046:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:1.0:1790772150.140220:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.140331:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412795904 00000100:00100000:0.0:1790772150.140339:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412795904 00000100:00100000:0.0:1790772150.140391:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:0.0:1790772150.140400:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25db8e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+38:10507:x1877760412795904:12345-192.168.206.27@tcp:35:lfs.0 00000004:00010000:0.0:1790772150.140462:0:5827:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a905c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b2a expref: 38 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772150.140733:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1790772150.140777:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1790772150.141056:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1790772150.141108:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.141265:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b07 expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.141275:0:5827:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.141307:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b07 expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.141322:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b07 expref: 42 pid: 5824 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772150.141335:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27fcab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5827:1877760428540928:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772150.141409:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acce40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772150.149809:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.150165:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412796032 00000100:00100000:3.0:1790772150.150173:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412796032 00010000:00010000:3.0:1790772150.150224:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b07 expref: 43 pid: 5824 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772150.150265:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:3.0:1790772150.150274:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+43:2347:x1877760412796032:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772150.150313:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772150.150320:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b07 expref: 43 pid: 5824 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.150333:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b07 expref: 43 pid: 5824 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.150353:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043400) 00010000:00010000:3.0:1790772150.150357:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.150367:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.150373:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.150405:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772150.150458:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+43:2347:x1877760412796032:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 184us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772150.150465:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00010000:00010000:0.0:1790772150.154234:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9057b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b07 expref: 42 pid: 5824 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772150.154287:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27fcab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5827:1877760428540928:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772150.154311:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772150.155305:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772150.155332:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772150.155459:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1790772150.155880:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1790772150.156062:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abef480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428541056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790772150.156190:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772150.156274:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772150.156315:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428541056 00000100:00100000:3.0:1790772150.156322:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428541056 00000100:00100000:3.0:1790772150.156451:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790772150.156461:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5827:x1877760428541056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790772150.156595:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5827:x1877760428541056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772150.156604:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772150.156805:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abef480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428541056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790772150.157260:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1790772150.157325:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27fcab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428541184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790772150.157376:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790772150.157654:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772150.157830:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772150.157895:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428541184 00000100:00100000:1.0:1790772150.157901:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428541184 00000100:00100000:1.0:1790772150.157932:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790772150.157940:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5827:x1877760428541184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790772150.158107:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5827:x1877760428541184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 167us (730us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790772150.158247:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27fcab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428541184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790772150.158298:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1790772150.158337:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.158360:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.158368:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.158375:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772150.158380:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.158388:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.158416:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043400) 00010000:00010000:0.0:1790772150.158419:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790772150.158424:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.158431:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772150.158794:0:5827:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790772150.158892:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1790772150.158902:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316303352433ns, next at 317303350182ns, rc = 0 00000001:00080000:0.0:1790772150.158909:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1790772150.158945:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043400) 00010000:00010000:0.0:1790772150.158949:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790772150.158956:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a905c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b2a expref: 46 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772150.159061:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25db8e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+45:10507:x1877760412795904:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 18661us (18848us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1790772150.159070:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 26 00000020:00080000:0.0:1790772150.159075:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790772150.159482:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790772150.161831:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.161930:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412796160 00000100:00100000:0.0:1790772150.161939:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412796160 00000100:00100000:0.0:1790772150.161989:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 100 00000100:00100000:0.0:1790772150.161998:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+45:10507:x1877760412796160:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772150.162017:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772150.162036:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a905dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b31 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.162101:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a905dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b31 expref: 46 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.162114:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a905dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b31 expref: 46 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.162275:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772150.162278:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772150.162281:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8200, rc 0) 00000100:00100000:0.0:1790772150.162351:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+46:10507:x1877760412796160:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 345us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772150.162358:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 100 00000100:00100000:1.0:1790772150.168788:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.169808:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412796416 00000100:00100000:3.0:1790772150.169826:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412796416 00000100:00100000:3.0:1790772150.169891:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:3.0:1790772150.169900:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+46:10507:x1877760412796416:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:3.0:1790772150.170240:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+47:10507:x1877760412796416:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 339us (1459us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1790772150.170248:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:3.0:1790772150.280185:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.280332:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412796544 00000100:00100000:0.0:1790772150.280342:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412796544 00000100:00100000:0.0:1790772150.280395:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 101 00000100:00100000:0.0:1790772150.280404:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+47:10517:x1877760412796544:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:0.0:1790772150.280468:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280494:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280504:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280517:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a905eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280540:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a905eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280580:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a905eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280668:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280699:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280707:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772150.280745:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280757:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280763:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280770:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280776:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772150.280780:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280789:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280808:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772150.280811:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772150.280816:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280822:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a905e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280838:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a905eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280845:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a905eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280850:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a905eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280855:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772150.280857:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a905eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280863:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a905eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280870:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df254043400) 00010000:00010000:0.0:1790772150.280872:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772150.280875:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a905eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280881:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a905eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280909:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280915:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280921:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280926:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772150.280929:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280935:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280942:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772150.280945:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772150.280948:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.280953:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a905f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772150.281017:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+47:10517:x1877760412796544:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 613us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772150.281025:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 101 00010000:00010000:1.0:1790772150.303853:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772150.353278:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.353500:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412796800 00000100:00100000:3.0:1790772150.353509:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412796800 00000100:00100000:3.0:1790772150.353627:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 102 00000100:00100000:3.0:1790772150.353638:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+47:10520:x1877760412796800:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772150.353657:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772150.353858:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a905f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b38 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.353928:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90600 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.353942:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90600 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.353953:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90600 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354034:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90607 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354044:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354051:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354401:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354411:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354419:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772150.354429:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790772150.354515:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90600 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354532:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90600 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354539:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90600 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354544:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772150.354571:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90600 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354579:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90600 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354590:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:3.0:1790772150.354593:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772150.354597:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90600 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354603:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90600 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354617:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354622:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90607 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354628:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354632:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772150.354641:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354647:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90607 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354654:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df247e07a00) 00010000:00010000:3.0:1790772150.354656:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772150.354659:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90607 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354665:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90607 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354719:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a905f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b38 expref: 50 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354734:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b38 expref: 49 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.354741:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:3.0:1790772150.354743:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772150.354746:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3200, rc 0) 00000100:00100000:3.0:1790772150.354858:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+49:10520:x1877760412796800:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1221us (1586us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1790772150.354865:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 102 00000100:00100000:1.0:1790772150.357864:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.357953:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412796928 00000100:00100000:0.0:1790772150.357962:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412796928 00000100:00100000:0.0:1790772150.358057:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 103 00000100:00100000:0.0:1790772150.358079:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+49:10520:x1877760412796928:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1790772150.358139:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9061c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.358156:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9061c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.358167:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9061c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.358205:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9061c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.358213:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9061c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.358219:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9061c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.358226:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772150.358230:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9061c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.358237:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9061c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.358248:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772150.358251:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772150.358255:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9061c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.358261:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9061c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772150.358339:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+49:10520:x1877760412796928:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 261us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772150.358346:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 103 00000100:00100000:1.0:1790772150.363670:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.363794:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412797184 00000100:00100000:3.0:1790772150.363803:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412797184 00000100:00100000:3.0:1790772150.363848:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:3.0:1790772150.363858:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+49:10520:x1877760412797184:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:3.0:1790772150.364067:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+50:10520:x1877760412797184:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 210us (404us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790772150.364075:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:2.0:1790772150.453964:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.454156:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412797440 00000100:00100000:0.0:1790772150.454166:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412797440 00000100:00100000:0.0:1790772150.454236:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 104 00000100:00100000:0.0:1790772150.454246:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+50:10530:x1877760412797440:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1790772150.454269:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772150.454272:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790772150.454295:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9059e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b1c expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.454317:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772150.454321:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772150.454335:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90623 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b3f expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.454419:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.454433:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b38 expref: 50 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.454440:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.454470:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b38 expref: 50 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.454496:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b38 expref: 50 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772150.454510:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27fcaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428541312:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772150.454646:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772150.463968:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.464641:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27fcaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428541312:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772150.464666:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772150.464760:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412797568 00000100:00100000:2.0:1790772150.464767:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412797568 00010000:00010000:2.0:1790772150.464801:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b38 expref: 51 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772150.464875:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:2.0:1790772150.464885:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+51:2347:x1877760412797568:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772150.464899:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772150.464906:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b38 expref: 51 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.464918:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b38 expref: 51 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.464944:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9060e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b38 expref: 51 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.464958:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:2.0:1790772150.464963:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.464983:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.464991:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.465035:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772150.465090:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+50:2347:x1877760412797568:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 206us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772150.465098:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 52 00010000:00010000:0.0:1790772150.465150:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.465158:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772150.465175:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790772150.465317:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90623 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b3f expref: 51 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.465338:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b3f expref: 50 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.465345:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772150.465348:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790772150.465350:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9a00, rc 0) 00000100:00100000:0.0:1790772150.465385:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+50:10530:x1877760412797440:12345-192.168.206.27@tcp:101:bash.0 Request processed in 11141us (11431us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1790772150.465401:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 104 00000100:00100000:1.0:1790772150.471739:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.471914:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412797824 00000100:00100000:3.0:1790772150.471924:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412797824 00000100:00100000:3.0:1790772150.472135:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 105 00000100:00100000:3.0:1790772150.472146:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+50:10530:x1877760412797824:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:3.0:1790772150.472526:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.472542:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.472702:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790772150.472768:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1790772150.472795:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b7374d81 reply state 00000000f705c552 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772150.472804:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772150.472895:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:10530:x1877760412797824:12345-192.168.206.27@tcp:36:bash.0 Request processed in 749us (1164us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1790772150.472902:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 105 00000020:00080000:3.0:1790772150.472907:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790772150.476330:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.476345:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.476428:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.476435:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772150.476440:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.476448:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.476463:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:3.0:1790772150.476466:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772150.476470:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.476476:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90638 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772150.478181:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.482628:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412797952 00000100:00100000:3.0:1790772150.482642:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412797952 00000100:00100000:3.0:1790772150.482708:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 106 00000100:00100000:3.0:1790772150.482718:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+52:10530:x1877760412797952:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1790772150.482739:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772150.482768:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9063f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b46 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.482864:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.482878:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b3f expref: 53 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.482893:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.482925:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b3f expref: 53 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.482948:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b3f expref: 53 pid: 6701 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772150.482962:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877760428541440:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772150.483883:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bb240 going to sleep for 11 seconds 00000100:00100000:1.0:1790772150.495597:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772150.495897:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412798080 00000100:00100000:2.0:1790772150.495906:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412798080 00010000:00010000:2.0:1790772150.495943:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b3f expref: 54 pid: 6701 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772150.495993:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:2.0:1790772150.496003:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+54:2347:x1877760412798080:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772150.496018:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772150.496024:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b3f expref: 54 pid: 6701 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.496038:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b3f expref: 54 pid: 6701 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.496058:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:2.0:1790772150.496064:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.496074:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.496081:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.496116:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772150.496174:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+54:2347:x1877760412798080:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 172us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772150.496181:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00010000:00010000:3.0:1790772150.497289:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a9062a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b3f expref: 53 pid: 6701 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772150.497314:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877760428541440:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772150.497333:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.497342:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.497348:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772150.497497:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790772150.497502:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772150.497522:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.497646:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9063f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b46 expref: 53 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.497662:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b46 expref: 52 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.497670:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:3.0:1790772150.497673:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772150.497675:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2400, rc 0) 00000100:00100000:3.0:1790772150.497742:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+52:10530:x1877760412797952:12345-192.168.206.27@tcp:101:bash.0 Request processed in 15025us (19574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772150.497758:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 106 00000100:00100000:3.0:1790772150.501274:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772150.501641:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412798336 00000100:00100000:2.0:1790772150.501651:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412798336 00000100:00100000:2.0:1790772150.501711:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:2.0:1790772150.501720:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+52:10530:x1877760412798336:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:2.0:1790772150.502067:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:10530:x1877760412798336:12345-192.168.206.27@tcp:35:bash.0 Request processed in 346us (800us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1790772150.502076:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:0.0:1790772150.593055:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.593165:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412798464 00000100:00100000:3.0:1790772150.593184:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412798464 00000100:00100000:3.0:1790772150.593242:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 107 00000100:00100000:3.0:1790772150.593251:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:10536:x1877760412798464:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772150.593273:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772150.593292:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9064d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b4d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.593348:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.593431:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.593460:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772150.593493:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790772150.593496:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772150.593511:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.593534:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a9064d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b4d expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.593583:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b4d expref: 54 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.593592:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:3.0:1790772150.593595:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772150.593599:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3c00, rc 0) 00000100:00100000:3.0:1790772150.593724:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+54:10536:x1877760412798464:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 474us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772150.593732:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 107 00000100:00100000:2.0:1790772150.600658:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.601143:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412798592 00000100:00100000:0.0:1790772150.601153:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412798592 00000100:00100000:0.0:1790772150.601723:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 108 00000100:00100000:0.0:1790772150.601737:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+54:10536:x1877760412798592:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772150.602370:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772150.602395:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9065b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b54 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.602606:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90662 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.602621:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.602633:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.602650:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90669 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.602658:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.602664:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.602860:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.602882:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.602890:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772150.602934:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790772150.602939:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772150.602956:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603154:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603164:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603170:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90662 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603177:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90662 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603184:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772150.603188:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90662 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603195:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90662 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603206:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772150.603209:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772150.603220:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90662 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603226:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603238:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603244:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90669 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603249:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603255:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772150.603257:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603263:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90669 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603271:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df254043400) 00010000:00010000:0.0:1790772150.603273:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772150.603275:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90669 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603280:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90669 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603315:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9065b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b54 expref: 56 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603345:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b54 expref: 55 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.603352:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772150.603354:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772150.603356:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9000, rc 0) 00000100:00100000:0.0:1790772150.603429:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:10536:x1877760412798592:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1695us (2778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772150.603437:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 108 00000100:00100000:2.0:1790772150.609979:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772150.610065:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.610785:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412798848 00000100:00100000:3.0:1790772150.610796:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412798848 00000100:00100000:3.0:1790772150.610855:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:3.0:1790772150.610864:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:10536:x1877760412798848:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772150.610883:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772150.610901:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90677 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b5b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.611032:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.611046:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b46 expref: 56 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.611065:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b54 expref: 56 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.611074:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.611104:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b54 expref: 56 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.611360:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b54 expref: 56 pid: 6701 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772150.611375:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428541568:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772150.611475:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b46 expref: 56 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.611483:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b46 expref: 56 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772150.611491:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428541696:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772150.611524:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772150.616403:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00010000:00010000:3.0:1790772150.616471:0:5823:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.27@tcp) returned -22 from blocking AST (req@0000000002588465 x1877760428541568) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b54 expref: 56 pid: 6701 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.616493:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b54 expref: 56 pid: 6701 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.616516:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b54 expref: 56 pid: 6701 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772150.616535:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428541568:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772150.616580:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428541696:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772150.616600:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:3.0:1790772150.616605:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.616614:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.616623:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772150.617905:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412798976 00000100:00100000:0.0:1790772150.617924:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412798976 00000100:00100000:0.0:1790772150.618128:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412799104 00000100:00100000:0.0:1790772150.618132:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412799104 00010000:00010000:0.0:1790772150.618150:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b46 expref: 57 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772150.618324:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00100000:0.0:1790772150.618333:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246097c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:2348:x1877760412799104:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772150.618347:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772150.618353:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b46 expref: 57 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.618365:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b46 expref: 57 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.618382:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b46 expref: 57 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.618409:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772150.618414:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.618423:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.618430:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.618454:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772150.618517:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246097c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:2348:x1877760412799104:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 184us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772150.618526:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00100000:0.0:1790772150.618544:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1790772150.618573:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:2348:x1877760412798976:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772150.618581:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772150.618584:0:7617:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie df68d9a7d6a90670) 00010000:00010000:0.0:1790772150.618585:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772150.618601:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:2348:x1877760412798976:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 31us (8544us total) trans 0 rc 116/116 00000100:00100000:0.0:1790772150.618607:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00010000:00010000:2.0:1790772150.620574:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.620590:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772150.620629:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790772150.620982:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90677 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b5b expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.621004:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b5b expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772150.621029:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:2.0:1790772150.621032:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790772150.621035:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3200, rc 0) 00000100:00100000:2.0:1790772150.621319:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:10536:x1877760412798848:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 10454us (11356us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1790772150.621329:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:3.0:1790772150.625018:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.625369:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412799360 00000100:00100000:0.0:1790772150.625379:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412799360 00000100:00100000:0.0:1790772150.625438:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:0.0:1790772150.625448:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:10536:x1877760412799360:12345-192.168.206.27@tcp:103:lfs.0 00010000:00010000:0.0:1790772150.625478:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772150.625500:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a905dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b31 expref: 55 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.625519:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772150.625524:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772150.625594:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+54:10536:x1877760412799360:12345-192.168.206.27@tcp:103:lfs.0 Request processed in 148us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772150.625602:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:0.0:1790772150.628054:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772150.628422:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412799488 00000100:00100000:3.0:1790772150.628430:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412799488 00000100:00100000:3.0:1790772150.628481:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 110 00000100:00100000:3.0:1790772150.628489:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+54:10536:x1877760412799488:12345-192.168.206.27@tcp:58:lfs.0 00010000:00010000:3.0:1790772150.628631:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.628648:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772150.628658:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772150.628830:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1790772150.628900:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+54:10536:x1877760412799488:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 412us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772150.628917:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 110 00000100:00100000:3.0:1790772150.631634:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772150.631815:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412799616 00000100:00100000:0.0:1790772150.631823:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412799616 00000100:00100000:0.0:1790772150.631871:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 111 00000100:00100000:0.0:1790772150.631880:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+54:10536:x1877760412799616:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772150.631898:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772150.632223:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90693 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b62 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.632275:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.632287:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90693 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b62 expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.632304:0:5824:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.632316:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90693 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b62 expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.632342:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772150.632345:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772150.632349:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90693 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b62 expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772150.632357:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9a00, rc 0) 00000100:00100000:0.0:1790772150.632415:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:10536:x1877760412799616:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 536us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772150.632422:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 111 00000040:00080000:0.0:1790772151.007906:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772151.007916:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772151.007960:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1790772151.007967:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790772151.008757:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abeea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428541824:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790772151.009000:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa600 going to sleep for 11 seconds 00000100:00100000:0.0:1790772151.014379:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abeea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428541824:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790772151.016862:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.019178:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412799744 00000100:00100000:3.0:1790772151.019194:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412799744 00000100:00100000:3.0:1790772151.019329:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 112 00000100:00100000:3.0:1790772151.019339:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:10537:x1877760412799744:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790772151.019369:0:5825:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790772151.019478:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:10537:x1877760412799744:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 139us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772151.019485:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 112 00000100:00080000:2.0:1790772151.019759:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772151.028620:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772151.028735:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412799872 00000100:00100000:2.0:1790772151.029248:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412799872 00000100:00100000:2.0:1790772151.029310:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 113 00000100:00100000:2.0:1790772151.029319:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:10537:x1877760412799872:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790772151.029618:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9069a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.029636:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9069a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.029650:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9069a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034221:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a906a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034243:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a906a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034255:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a906a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034302:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034312:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034319:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772151.034434:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790772151.034439:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772151.034454:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034466:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9069a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034473:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9069a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034479:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9069a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034487:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772151.034490:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9069a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034497:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9069a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034507:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:2.0:1790772151.034516:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772151.034521:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9069a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034526:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9069a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034541:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a906a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034547:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a906a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034569:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a906a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034574:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aae00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772151.034578:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a906a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034584:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a906a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034593:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8df25a490700) 00010000:00010000:2.0:1790772151.034596:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772151.034599:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a906a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034605:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a906a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034625:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034638:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034643:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034648:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772151.034651:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034657:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034664:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:2.0:1790772151.034666:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772151.034669:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.034675:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a906a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772151.034779:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:10537:x1877760412799872:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 Request processed in 5456us (6164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772151.034789:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 113 00000100:00100000:1.0:1790772151.042894:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.043069:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412800128 00000100:00100000:3.0:1790772151.043079:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412800128 00000100:00100000:3.0:1790772151.043135:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:3.0:1790772151.043144:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:10537:x1877760412800128:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772151.043163:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772151.043194:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b69 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043285:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a906b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043300:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a906b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043311:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a906b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772151.043322:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790772151.043546:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a906b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043583:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a906b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043590:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a906b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043596:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772151.043600:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a906b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043608:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a906b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043619:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:3.0:1790772151.043622:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790772151.043626:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a906b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043641:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a906b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043678:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906af lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b69 expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043700:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:3.0:1790772151.043703:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772151.043706:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b69 expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.043715:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3400, rc 0) 00000100:00100000:3.0:1790772151.043822:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:10537:x1877760412800128:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 679us (938us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1790772151.043830:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:0.0:1790772151.050400:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772151.050573:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412800256 00000100:00100000:1.0:1790772151.050582:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412800256 00000100:00100000:1.0:1790772151.050640:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 115 00000100:00100000:1.0:1790772151.050664:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:10537:x1877760412800256:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790772151.050708:0:5824:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790772151.050819:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:10537:x1877760412800256:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 157us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772151.050827:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 115 00000100:00100000:3.0:1790772151.058288:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.058787:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412800512 00000100:00100000:0.0:1790772151.058797:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412800512 00000100:00100000:0.0:1790772151.058854:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 116 00000100:00100000:0.0:1790772151.058864:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:10537:x1877760412800512:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772151.058883:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772151.058886:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790772151.058910:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b4d expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.058945:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772151.058949:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772151.058977:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b70 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772151.059839:0:6701:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1790772151.060023:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a906cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.060038:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a906cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.060049:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a906cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.060103:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b70 expref: 58 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.060121:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a906cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b70 expref: 57 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.060129:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df254043400) 00010000:00010000:0.0:1790772151.060132:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772151.060134:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9e00, rc 0) 00000100:00100000:0.0:1790772151.060209:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:10537:x1877760412800512:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1346us (1930us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1790772151.060217:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 116 00000100:00100000:3.0:1790772151.069753:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772151.069852:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412800768 00000100:00100000:1.0:1790772151.069861:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412800768 00000100:00100000:1.0:1790772151.069920:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 117 00000100:00100000:1.0:1790772151.069930:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:10537:x1877760412800768:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790772151.069995:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772151.070020:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a906cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b70 expref: 57 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070041:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df254043400) 00010000:00010000:1.0:1790772151.070051:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772151.070070:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a906d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070082:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a906d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070090:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a906d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070103:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a906e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9f582f7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070109:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a906e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f582f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070127:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a906e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f582f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070185:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a906d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070205:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a906d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070212:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a906d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070217:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772151.070220:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a906d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070227:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a906d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070235:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:1.0:1790772151.070238:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772151.070242:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a906d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070248:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a906d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070257:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a906e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f582f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070263:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a906e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f582f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070274:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a906e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f582f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070279:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772151.070282:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a906e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f582f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070287:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a906e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f582f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070295:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9f582f7a (ffff8df27c001400) 00010000:00010000:1.0:1790772151.070297:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772151.070300:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a906e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9f582f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.070305:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a906e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9f582f7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772151.070661:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:10537:x1877760412800768:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 731us (930us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790772151.070669:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 117 00000100:00100000:1.0:1790772151.073265:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.073471:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412800896 00000100:00100000:3.0:1790772151.073480:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412800896 00000100:00100000:3.0:1790772151.073535:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 118 00000100:00100000:3.0:1790772151.073544:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:10537:x1877760412800896:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772151.073593:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772151.073614:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a906e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b77 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.073647:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.073675:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.073695:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.073906:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a906e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b77 expref: 58 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.073924:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b77 expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.073932:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:3.0:1790772151.073934:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790772151.073938:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3400, rc 0) 00000100:00100000:3.0:1790772151.074063:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:10537:x1877760412800896:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 518us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772151.074070:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 118 00000100:00100000:3.0:1790772151.077493:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.078504:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412801152 00000100:00100000:0.0:1790772151.078515:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412801152 00000100:00100000:0.0:1790772151.078707:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00100000:0.0:1790772151.078719:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:10537:x1877760412801152:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772151.078813:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.078831:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.078843:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772151.079196:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1790772151.079207:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 317223656743ns, next at 318223654356ns, rc = 0 00000004:00010000:0.0:1790772151.079283:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f470e9b6 reply state 000000001f898ab5 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772151.079293:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772151.079449:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:10537:x1877760412801152:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 731us (1962us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1790772151.079456:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 119 00010000:00010000:2.0:1790772151.082018:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.082033:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.082040:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.082060:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772151.082065:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.082073:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.082087:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:2.0:1790772151.082090:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790772151.082094:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.082100:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a906f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772151.082364:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.082592:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412801280 00000100:00100000:0.0:1790772151.082602:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412801280 00000100:00100000:0.0:1790772151.082650:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00100000:0.0:1790772151.082658:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:10537:x1877760412801280:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772151.082679:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772151.082706:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a906fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b7e expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.082777:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a906fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b7e expref: 59 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.082790:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a906fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b7e expref: 59 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.082807:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:0.0:1790772151.082810:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772151.082813:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8c00, rc 0) 00000100:00100000:0.0:1790772151.082859:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:10537:x1877760412801280:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 202us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772151.082866:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00100000:1.0:1790772151.086228:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.086311:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412801408 00000100:00100000:3.0:1790772151.086320:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412801408 00000100:00100000:3.0:1790772151.086394:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:3.0:1790772151.086403:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412801408:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790772151.086714:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2347:x1877760412801408:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 311us (494us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790772151.086723:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00080000:2.0:1790772151.087012:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772151.089524:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.089637:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412801664 00000100:00100000:3.0:1790772151.089647:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412801664 00000100:00100000:3.0:1790772151.089701:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00100000:3.0:1790772151.089711:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:10537:x1877760412801664:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790772151.089942:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:10537:x1877760412801664:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 232us (425us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1790772151.089950:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00100000:1.0:1790772151.092516:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.092639:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412801920 00000100:00100000:0.0:1790772151.092650:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412801920 00000100:00100000:0.0:1790772151.092718:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 121 00000100:00100000:0.0:1790772151.092727:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:10537:x1877760412801920:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790772151.092839:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:10537:x1877760412801920:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 113us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772151.092846:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 121 00000100:00100000:1.0:1790772151.095642:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.095815:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412802048 00000100:00100000:0.0:1790772151.095824:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412802048 00000100:00100000:0.0:1790772151.095880:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 122 00000100:00100000:0.0:1790772151.095889:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:10537:x1877760412802048:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772151.095907:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772151.095927:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90703 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b85 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.096016:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9070a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.096032:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9070a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.096042:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9070a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772151.096074:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772151.096091:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9070a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.096114:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a90703 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b85 expref: 62 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.096131:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9070a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b85 expref: 61 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.096141:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:0.0:1790772151.096144:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790772151.096147:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9e00, rc 0) 00000100:00100000:0.0:1790772151.096347:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:10537:x1877760412802048:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 458us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772151.096420:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 122 00000100:00100000:1.0:1790772151.099863:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.099957:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412802176 00000100:00100000:0.0:1790772151.099978:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412802176 00000100:00100000:0.0:1790772151.100083:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:0.0:1790772151.100107:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f971f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2348:x1877760412802176:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772151.100126:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772151.100146:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000659292e2/0xdf68d9a7d6a90711 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b8c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772151.100172:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd03b6, blocks: 0x1 00010000:00010000:0.0:1790772151.100204:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=317s v=(0 0) 00010000:00010000:0.0:1790772151.100209:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772151.100218:0:6678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000659292e2/0xdf68d9a7d6a90711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b8c expref: 10 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.100237:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000659292e2/0xdf68d9a7d6a90711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b8c expref: 10 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.100251:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8200, rc 0) 00000100:00100000:0.0:1790772151.100311:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f971f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:2348:x1877760412802176:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 206us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772151.100319:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:1.0:1790772151.104340:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.104484:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412802432 00000100:00100000:0.0:1790772151.104494:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412802432 00000100:00100000:0.0:1790772151.104589:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 123 00000100:00100000:0.0:1790772151.104600:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:10537:x1877760412802432:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790772151.104706:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:10537:x1877760412802432:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 108us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772151.104713:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 123 00000100:00100000:1.0:1790772151.108336:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.108663:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412802560 00000100:00100000:3.0:1790772151.108672:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412802560 00000100:00100000:3.0:1790772151.108774:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:3.0:1790772151.108785:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:10537:x1877760412802560:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772151.108803:0:8509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772151.108820:0:8509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b93 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.108848:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000659292e2/0xdf68d9a7d6a90711 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b8c expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.108857:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772151.108861:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772151.108866:0:8509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 11 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.108895:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000659292e2/0xdf68d9a7d6a90711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b8c expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.108926:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000659292e2/0xdf68d9a7d6a90711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b8c expref: 11 pid: 6678 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772151.108940:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b0ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8509:1877760428541952:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772151.109042:0:8509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bb240 going to sleep for 11 seconds 00000100:00100000:1.0:1790772151.111326:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.111717:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b0ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8509:1877760428541952:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772151.111747:0:8509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 11 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.111766:0:8509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2a00, rc 0) 00000100:00100000:3.0:1790772151.111821:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:10537:x1877760412802560:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 3038us (3491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772151.111829:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:0.0:1790772151.111968:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412802688 00000100:00100000:0.0:1790772151.111975:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412802688 00010000:00010000:0.0:1790772151.112005:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000659292e2/0xdf68d9a7d6a90711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b8c expref: 11 pid: 6678 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772151.112037:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:0.0:1790772151.112046:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f971180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:2347:x1877760412802688:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772151.112059:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772151.112079:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000659292e2/0xdf68d9a7d6a90711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b8c expref: 11 pid: 6678 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.112091:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000659292e2/0xdf68d9a7d6a90711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b8c expref: 11 pid: 6678 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.112112:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000659292e2/0xdf68d9a7d6a90711 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b8c expref: 11 pid: 6678 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.112125:0:7617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772151.112128:0:7617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772151.112135:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 10 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.112145:0:7617:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 10 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.112185:0:7617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 10 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772151.112208:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7617:1877760428542080:192.168.206.27@tcp:105: 00000100:00100000:0.0:1790772151.112269:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772151.116541:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772151.116721:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412802816 00000100:00100000:2.0:1790772151.116729:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412802816 00000100:00100000:0.0:1790772151.116732:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7617:1877760428542080:192.168.206.27@tcp:105: 00010000:00010000:0.0:1790772151.116752:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1790772151.116783:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8df27f972d80 x1877760412802816/t0(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:497/0 lens 504/0 e 0 to 0 dl 1790772162 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790772151.116793:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27f972d80 with x1877760412802816 ext(0->12) 00000100:00100000:0.0:1790772151.116796:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f971180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:2347:x1877760412802688:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 4752us (5479us total) trans 0 rc 0/0 00002000:00010000:2.0:1790772151.116799:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27f972d80 00000100:00100000:0.0:1790772151.116805:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:2.0:1790772151.116828:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:2.0:1790772151.116837:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:2348:x1877760412802816:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790772151.117246:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+12:2348:x1877760412802816:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 Request processed in 409us (713us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790772151.117262:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00002000:00100000:2.0:1790772151.117269:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8df27f972d80 x1877760412802816/t4294967308(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:497/0 lens 504/448 e 0 to 0 dl 1790772162 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790772151.117277:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27f972d80 with x1877760412802816 ext(0->12) 00002000:00010000:2.0:1790772151.117280:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27f972d80 00000100:00100000:1.0:1790772151.119667:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.119815:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412802944 00000100:00100000:3.0:1790772151.119824:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412802944 00000100:00100000:3.0:1790772151.119868:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 124 00000100:00100000:3.0:1790772151.119877:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:10537:x1877760412802944:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790772151.156348:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1790772151.156361:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1790772151.156385:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1790772151.156404:0:5845:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df142acc0c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1790772151.156409:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df24401ec00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df142acce40 00000020:00080000:0.0:1790772151.156413:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df24401e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df27478a800 00000020:00080000:0.0:1790772151.156453:0:5845:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df27fcfa540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1790772151.156456:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df274515b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df27fcfad80 00000020:00080000:0.0:1790772151.156459:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df274515200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df274788400 00000001:00080000:0.0:1790772151.156498:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1790772151.156512:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1790772151.156576:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:10537:x1877760412802944:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 Request processed in 36673us (36891us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772151.156587:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 124 00000100:00100000:2.0:1790772151.157087:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428542336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790772151.157161:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772151.157192:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772151.157199:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428542208:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790772151.157220:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772151.157250:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428542336 00000100:00100000:2.0:1790772151.157256:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428542336 00000100:00100000:2.0:1790772151.157297:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428542208 00000100:00100000:2.0:1790772151.157300:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428542208 00000100:00100000:2.0:1790772151.157320:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790772151.157327:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27414e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3294:x1877760428542336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1790772151.157470:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790772151.157480:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790772150 00002000:00010000:2.0:1790772151.157483:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790772151.157485:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790772150 -> 1790772150 00002000:00010000:2.0:1790772151.157487:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790772151.157522:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27414e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3294:x1877760428542336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (360us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790772151.157533:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790772151.157698:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790772151.157719:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3294:x1877760428542208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790772151.157733:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1790772151.158082:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.158115:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a904e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af2 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.158184:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1790772151.158188:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772151.158193:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.158223:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a904e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af2 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.158242:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a904e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af2 expref: 11 pid: 6679 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772151.158255:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1877760428542464:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772151.158315:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927b180 going to sleep for 11 seconds 00000100:00080000:2.0:1790772151.158333:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1790772151.158363:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df26f8d7b80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1790772151.158369:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428542336:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1790772151.158926:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1790772151.159093:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790772151.159111:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772151.159134:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428542592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790772151.159178:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772151.159224:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428542592 00000100:00100000:0.0:1790772151.159229:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428542592 00000100:00100000:0.0:1790772151.159258:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790772151.159266:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1877760428542592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790772151.159287:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1790772151.159314:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abd03b5, atime: 0x6abd03b5, ctime: 0x6abd03b5, blocks: 0x1 00010000:00010000:0.0:1790772151.159327:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90726 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.159340:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=317s v=(0 0) 00010000:00010000:0.0:1790772151.159344:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772151.159351:0:6678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.159366:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.159375:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.159383:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.159399:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790772151.159881:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1877760428542592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 613us (701us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790772151.159889:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1790772151.159923:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772151.159929:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.159938:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772151.159943:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.159953:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.159969:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90726 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.159976:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000659292e2/0xdf68d9a7d6a90726 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.159994:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772151.159996:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772151.159998:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790772151.160074:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df27abece00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1790772151.160081:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428542592:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790772151.160114:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.165581:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412803072 00000100:00100000:0.0:1790772151.165595:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412803072 00000100:00100000:0.0:1790772151.165658:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:0.0:1790772151.165668:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+12:2347:x1877760412803072:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790772151.174364:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1877760428542464:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772151.174391:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772151.179888:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.180740:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412803200 00000100:00100000:0.0:1790772151.182057:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412803200 00010000:00010000:0.0:1790772151.182166:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a904e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af2 expref: 13 pid: 6679 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772151.182219:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:0.0:1790772151.182228:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:2347:x1877760412803200:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772151.182244:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772151.182250:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a904e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af2 expref: 13 pid: 6679 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.182263:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a904e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af2 expref: 13 pid: 6679 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.182286:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a904e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226af2 expref: 13 pid: 6679 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.182301:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772151.182305:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772151.182310:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.182318:0:5809:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.182352:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772151.183204:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.183217:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.183227:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.183235:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.183250:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790772151.183257:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+12:2347:x1877760412803200:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 1029us (3379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772151.183278:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:1.0:1790772151.184957:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3294:x1877760428542208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27233us (27731us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790772151.184979:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1790772151.185009:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772151.185017:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.185028:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772151.185033:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.185051:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.185069:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.185075:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ea4a3de/0xdf68d9a7d6a9071f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.185094:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772151.185096:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772151.185097:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790772151.194486:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df26f8d6300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1790772151.194499:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428542208:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1790772151.212680:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1790772151.212740:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1790772151.212745:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1790772151.212953:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412803072:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 Request processed in 47281us (52837us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772151.212970:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:3.0:1790772151.220716:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.221040:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412803456 00000100:00100000:0.0:1790772151.221050:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412803456 00000100:00100000:0.0:1790772151.221110:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 125 00000100:00100000:0.0:1790772151.221120:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:10537:x1877760412803456:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772151.221187:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772151.221213:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9070a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b85 expref: 15 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.221237:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:0.0:1790772151.221241:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772151.221270:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.221298:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.221307:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772151.222235:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000ba9863b reply state 00000000d5b16037 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772151.222251:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772151.222385:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:10537:x1877760412803456:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1264us (1676us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1790772151.222393:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 125 00010000:00010000:3.0:1790772151.225835:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.225919:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.225927:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.225934:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772151.225939:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.225948:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.225970:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:3.0:1790772151.225974:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772151.225978:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.225985:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a9072d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772151.226127:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.226584:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412803584 00000100:00100000:3.0:1790772151.226593:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412803584 00000100:00100000:3.0:1790772151.226647:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:3.0:1790772151.226656:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412803584:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790772151.226879:0:8509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790772151.226883:0:8509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1790772150 -> 1790772149 00002000:00010000:3.0:1790772151.226897:0:8509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790772149 00002000:00010000:3.0:1790772151.226899:0:8509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790772150 -> 1790772149 00002000:00010000:3.0:1790772151.226901:0:8509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790772151.226957:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412803584:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 301us (833us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790772151.226979:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:1.0:1790772151.231061:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.231198:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412803840 00000100:00100000:0.0:1790772151.231207:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412803840 00000100:00100000:0.0:1790772151.231265:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 126 00000100:00100000:0.0:1790772151.231274:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:10537:x1877760412803840:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790772151.231348:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.231386:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b77 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.231397:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.231431:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b77 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.231446:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b77 expref: 15 pid: 5825 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772151.231459:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abef800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428542720:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772151.231588:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772151.235650:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abef800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428542720:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772151.235681:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772151.237829:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.237901:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412803968 00000100:00100000:3.0:1790772151.237910:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412803968 00010000:00010000:3.0:1790772151.237947:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b77 expref: 16 pid: 5825 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772151.237988:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:3.0:1790772151.237998:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f971500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:2348:x1877760412803968:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772151.238011:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772151.238017:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b77 expref: 16 pid: 5825 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.238031:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b77 expref: 16 pid: 5825 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.238050:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a906ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b77 expref: 16 pid: 5825 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.238065:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:3.0:1790772151.238070:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.238079:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.238098:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.238125:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772151.238307:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.238316:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.238343:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.238351:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.238371:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.238377:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772151.238381:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.238388:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.238397:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:2.0:1790772151.238407:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790772151.238412:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.238418:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9000/0xdf68d9a7d6a90734 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772151.238708:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f971500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:2348:x1877760412803968:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 710us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772151.238718:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:2.0:1790772151.240004:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10537:x1877760412803840:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 Request processed in 8723us (8946us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790772151.240016:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 126 00000100:00100000:0.0:1790772151.243039:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772151.243173:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412804096 00000100:00100000:1.0:1790772151.243182:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412804096 00000100:00100000:1.0:1790772151.243239:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:1.0:1790772151.243249:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2350:x1877760412804096:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790772151.243319:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.243341:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 7 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.243350:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772151.243476:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790772151.243482:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.243518:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 7 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.243534:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 7 pid: 8509 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772151.243580:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f973100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1877760428542848:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772151.243659:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df242f510c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772151.246900:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f973100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1877760428542848:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772151.246930:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772151.247374:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772151.247504:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412804224 00000100:00100000:1.0:1790772151.247511:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412804224 00010000:00010000:1.0:1790772151.247544:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 8 pid: 8509 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772151.247600:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:1.0:1790772151.247609:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412804224:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772151.247636:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772151.247659:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 8 pid: 8509 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.247671:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 8 pid: 8509 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.247702:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016409ebe/0xdf68d9a7d6a90718 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b93 expref: 8 pid: 8509 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.247717:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790772151.247721:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790772151.247726:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.247736:0:5809:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.247776:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772151.247831:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412804224:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 223us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772151.247838:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 58 00010000:00010000:3.0:1790772151.247898:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.247908:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.247933:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.247943:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.247951:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.247975:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772151.247980:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.247989:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.248001:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.248008:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686e9d38/0xdf68d9a7d6a9073b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772151.248052:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2350:x1877760412804096:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 Request processed in 4805us (5021us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772151.248059:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:1.0:1790772151.251450:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772151.251504:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412804480 00000100:00100000:2.0:1790772151.251514:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412804480 00000100:00100000:2.0:1790772151.251606:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 127 00000100:00100000:2.0:1790772151.251616:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10537:x1877760412804480:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790772151.251699:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90742 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.251717:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.251727:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.251916:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.251928:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a906fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b7e expref: 15 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.251936:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.251980:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a906fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b7e expref: 15 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772151.251993:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a906fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b7e expref: 15 pid: 6701 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772151.252007:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428542976:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772151.252078:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927b840 going to sleep for 11 seconds 00000100:00100000:2.0:1790772151.255257:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.255411:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428542976:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772151.255437:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772151.255642:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412804608 00000100:00100000:3.0:1790772151.255649:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412804608 00010000:00010000:3.0:1790772151.255690:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a906fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b7e expref: 16 pid: 6701 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772151.255728:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:3.0:1790772151.255737:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:2347:x1877760412804608:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772151.255761:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772151.255768:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a906fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b7e expref: 16 pid: 6701 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.255791:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a906fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b7e expref: 16 pid: 6701 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.255810:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a906fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b7e expref: 16 pid: 6701 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.255825:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:3.0:1790772151.255830:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.255838:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.255846:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.255873:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772151.255923:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:2347:x1877760412804608:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 187us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772151.255931:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 59 00010000:00010000:0.0:1790772151.256916:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.256929:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772151.257138:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1790772151.258046:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1790772151.258131:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1790772151.258229:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877760428543104:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790772151.258897:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772151.258934:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772151.259237:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428543104 00000100:00100000:1.0:1790772151.259245:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428543104 00000100:00100000:1.0:1790772151.259298:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772151.259307:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1877760428543104:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790772151.259580:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1877760428543104:12345-0@lo:1000:mdt00_000.0 Request processed in 273us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772151.259588:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772151.259766:0:5823:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1790772151.259773:0:5823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1790772151.259791:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df26f8d7b80, transno 4294967309 00000100:00100000:0.0:1790772151.259845:0:5823:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8df26f8d6300 x1877760428542208/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790772167 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772151.259856:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877760428543104:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790772151.260344:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1790772151.260670:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877760428543232:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790772151.260723:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772151.260930:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772151.261079:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428543232 00000100:00100000:1.0:1790772151.261086:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428543232 00000100:00100000:1.0:1790772151.261131:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772151.261139:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1877760428543232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790772151.261710:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5823:x1877760428543232:12345-0@lo:1000:mdt00_000.0 Request processed in 570us (985us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790772151.261719:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772151.261885:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877760428543232:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790772151.261922:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.261933:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.261941:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.261947:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772151.261951:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.261959:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.261998:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07a00) 00010000:00010000:0.0:1790772151.262000:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772151.262005:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.262011:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90749 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.262039:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.262046:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.262052:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.262056:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772151.262059:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.262064:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.262071:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772151.262073:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772151.262079:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90693 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b62 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.262090:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90693 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b62 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.262106:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90693 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b62 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.262136:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90693 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b62 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772151.262148:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428543360:192.168.206.27@tcp:105: 00000100:00100000:0.0:1790772151.262496:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1780 going to sleep for 11 seconds 00000100:00100000:2.0:1790772151.266962:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.267086:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412804736 00000100:00100000:3.0:1790772151.267095:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412804736 00000100:00100000:3.0:1790772151.267154:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:3.0:1790772151.267163:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10536:x1877760412804736:12345-192.168.206.27@tcp:49:lfs.0 00000100:00100000:3.0:1790772151.267307:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10536:x1877760412804736:12345-192.168.206.27@tcp:49:lfs.0 Request processed in 143us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772151.267315:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:3.0:1790772151.270336:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772151.270423:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412804992 00000100:00100000:1.0:1790772151.270433:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412804992 00000100:00100000:1.0:1790772151.270506:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 128 00000100:00100000:1.0:1790772151.270516:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10536:x1877760412804992:12345-192.168.206.27@tcp:58:lfs.0 00000100:00100000:0.0:1790772151.270804:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428543360:192.168.206.27@tcp:105: 00010000:00010000:0.0:1790772151.270830:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270840:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a9068c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270866:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90750 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270879:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90750 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270890:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90750 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772151.270894:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:0.0:1790772151.270899:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90750 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270904:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90750 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270917:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90750 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270922:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772151.270925:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90750 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270932:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90750 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270943:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772151.270945:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772151.270948:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90750 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270953:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90750 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772151.270972:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10536:x1877760412804992:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 457us (643us total) trans 0 rc 0/0 00010000:00010000:0.0:1790772151.270976:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772151.270980:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 128 00010000:00010000:0.0:1790772151.270982:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90742 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270987:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.270992:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772151.270995:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.271012:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90742 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.271021:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772151.271024:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790772151.271027:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90742 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.271033:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90742 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772151.271134:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+18:10537:x1877760412804480:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 19519us (19692us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1790772151.271141:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 127 00000020:00080000:0.0:1790772151.271144:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790772151.271332:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790772151.271336:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772151.271387:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790772151.271393:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772151.271576:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f973100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428543488:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790772151.271631:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df242f513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772151.278363:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.278445:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412805248 00000100:00100000:3.0:1790772151.278455:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412805248 00000100:00100000:3.0:1790772151.278513:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:3.0:1790772151.278522:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25db8f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:10537:x1877760412805248:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790772151.279212:0:5826:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790772151.279321:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1790772151.284739:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.284761:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.284772:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.284782:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.284787:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.284794:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.284821:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772151.284861:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772151.284870:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.284888:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772151.284893:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.284901:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.284915:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df247e07100) 00010000:00010000:0.0:1790772151.284918:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790772151.284937:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.284943:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90757 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772151.284958:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25db8f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10537:x1877760412805248:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 6432us (6598us total) trans 4294967408 rc 0/0 00010000:00010000:0.0:1790772151.284963:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772151.284966:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772151.284969:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772151.284973:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 32 00000020:00080000:3.0:1790772151.284980:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790772151.290009:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.290659:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412805376 00000100:00100000:0.0:1790772151.290668:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412805376 00000100:00100000:0.0:1790772151.290731:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 129 00000100:00100000:0.0:1790772151.290741:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10538:x1877760412805376:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790772151.290773:0:5824:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790772151.290885:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:10538:x1877760412805376:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 145us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772151.290894:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 129 00000100:00100000:1.0:1790772151.293745:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f973100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428543488:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790772151.294885:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772151.295010:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412805632 00000100:00100000:3.0:1790772151.295018:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412805632 00000100:00100000:3.0:1790772151.295073:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 130 00000100:00100000:3.0:1790772151.295083:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:10538:x1877760412805632:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772151.295118:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772151.295137:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9075e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226b9a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.295239:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.295254:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.295263:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772151.295273:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790772151.295374:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a9075e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b9a expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.295392:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b9a expref: 22 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772151.295400:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:3.0:1790772151.295403:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790772151.295406:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2a00, rc 0) 00000100:00100000:3.0:1790772151.295472:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:10538:x1877760412805632:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 391us (591us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1790772151.295489:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 130 00000100:00100000:0.0:1790772151.300478:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772151.300586:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412805888 00000100:00100000:1.0:1790772151.300596:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412805888 00000100:00100000:1.0:1790772151.300643:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 131 00000100:00100000:1.0:1790772151.300651:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:10538:x1877760412805888:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790772151.300729:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90773 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.300753:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.300764:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.300921:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.300929:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90773 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.300936:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.300942:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772151.300946:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.300953:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90773 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.300976:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:1.0:1790772151.300980:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790772151.300997:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90773 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.301004:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90773 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772151.301146:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:10538:x1877760412805888:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 494us (695us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1790772151.301154:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 131 00000040:00080000:0.0:1790772151.301430:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772151.301435:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772151.301986:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790772151.301996:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772151.318749:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.318815:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412806144 00000100:00100000:0.0:1790772151.318824:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412806144 00000100:00100000:0.0:1790772151.318879:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:0.0:1790772151.318888:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:10538:x1877760412806144:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790772151.319112:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:10538:x1877760412806144:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 224us (371us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1790772151.319135:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:2.0:1790772151.321625:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.321717:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412806272 00000100:00100000:0.0:1790772151.321725:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412806272 00000100:00100000:0.0:1790772151.321787:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 132 00000100:00100000:0.0:1790772151.321795:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:10540:x1877760412806272:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772151.321812:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772151.321830:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9077a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ba1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.321888:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90781 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.321901:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.321911:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.321924:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90788 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.321931:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.321937:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.322163:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.322183:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b5b expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.322191:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.322221:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b5b expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.322233:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b5b expref: 25 pid: 5823 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772151.322247:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428543616:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772151.322329:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1780 going to sleep for 11 seconds 00010000:00010000:1.0:1790772151.328539:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772151.328763:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.328904:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428543616:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772151.328932:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772151.328999:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412806528 00000100:00100000:3.0:1790772151.329006:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412806528 00000100:00100000:3.0:1790772151.329060:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:3.0:1790772151.329070:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:5587:x1877760412806528:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790772151.329301:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:5587:x1877760412806528:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 232us (543us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1790772151.329310:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:1.0:1790772151.332623:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772151.332703:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412806656 00000100:00100000:0.0:1790772151.332715:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412806656 00010000:00010000:0.0:1790772151.332755:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b5b expref: 27 pid: 5823 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772151.332799:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:0.0:1790772151.332809:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246097050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:2349:x1877760412806656:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772151.332823:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772151.332841:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b5b expref: 27 pid: 5823 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.332854:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b5b expref: 27 pid: 5823 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.332875:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a9067e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b5b expref: 27 pid: 5823 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.332896:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772151.332901:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.332910:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.332917:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772151.332988:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772151.333042:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246097050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:2349:x1877760412806656:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 235us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772151.333049:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 60 00010000:00010000:1.0:1790772151.333965:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.333977:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772151.334018:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790772151.334023:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772151.334041:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334059:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334069:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334075:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90781 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334081:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90781 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334099:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772151.334104:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90781 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334111:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90781 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334123:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:1.0:1790772151.334125:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772151.334130:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334135:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a90781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334148:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334154:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90788 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334159:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334164:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772151.334166:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334172:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90788 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334697:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8df254043b00) 00010000:00010000:1.0:1790772151.334701:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772151.334705:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90788 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334712:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a90788 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334754:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a9077a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ba1 expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334772:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ba1 expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772151.334780:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:1.0:1790772151.334782:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772151.334785:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9e00, rc 0) 00000100:00100000:1.0:1790772151.334907:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:10540:x1877760412806272:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 13111us (13289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772151.334915:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 132 00000001:00080000:0.0:1790772151.873470:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1790772151.873486:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:3.0:1790772152.327746:0:12035:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790772152.327757:0:12035:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790772152.327815:0:12035:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790772152.327821:0:12035:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790772152.352029:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772152.481053:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772152.483127:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412806912 00000100:00100000:1.0:1790772152.483142:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412806912 00000100:00100000:1.0:1790772152.483199:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 133 00000100:00100000:1.0:1790772152.483209:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:10563:x1877760412806912:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772152.483234:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772152.483254:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ba8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772152.483359:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9079d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772152.483373:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9079d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772152.483384:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9079d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772152.483394:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790772152.483504:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ba8 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772152.483521:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9079d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ba8 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772152.483530:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:1.0:1790772152.483533:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790772152.483536:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9a00, rc 0) 00000100:00100000:1.0:1790772152.483608:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10563:x1877760412806912:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 400us (2565us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1790772152.483616:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 133 00000100:00100000:0.0:1790772152.498245:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772152.498294:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412807040 00000100:00100000:0.0:1790772152.498303:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412807040 00000100:00100000:0.0:1790772152.498358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 134 00000100:00100000:0.0:1790772152.498368:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10563:x1877760412807040:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1790772152.498440:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a907ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.498458:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a907ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.498469:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a907ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.498492:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a907ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.498499:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a907ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.498506:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a907ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.498513:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772152.498517:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a907ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.498526:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a907ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.498576:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772152.498580:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772152.498584:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a907ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.498591:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8600/0xdf68d9a7d6a907ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772152.498668:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:10563:x1877760412807040:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 300us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772152.498687:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 134 00000100:00100000:3.0:1790772152.621199:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772152.621299:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412807168 00000100:00100000:0.0:1790772152.621309:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412807168 00000100:00100000:0.0:1790772152.621377:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:0.0:1790772152.621388:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412807168:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:0.0:1790772152.621405:0:8509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772152.621424:0:8509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daece798/0xdf68d9a7d6a907b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226baf expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772152.621448:0:8509:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abd03b5, atime: 0x6abd03b5, ctime: 0x6abd03b5, blocks: 0xb 00010000:00010000:0.0:1790772152.621466:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:0.0:1790772152.621470:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772152.621479:0:8509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daece798/0xdf68d9a7d6a907b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226baf expref: 7 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.621496:0:8509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000daece798/0xdf68d9a7d6a907b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226baf expref: 7 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772152.621508:0:8509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8600, rc 0) 00000100:00100000:0.0:1790772152.621668:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412807168:12345-192.168.206.27@tcp:101:cat.0 Request processed in 282us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772152.621688:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:0.0:1790772152.628045:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772152.628242:0:6683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412807296 00000100:00100000:2.0:1790772152.628254:0:6683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412807296 00002000:00100000:2.0:1790772152.628314:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8df26f64b100 x1877760412807296/t0(0) o3->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:498/0 lens 488/0 e 0 to 0 dl 1790772163 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790772152.628326:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df26f64b100 with x1877760412807296 ext(0->4095) 00002000:00010000:2.0:1790772152.628334:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df26f64b100 00000100:00100000:2.0:1790772152.628373:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:2.0:1790772152.628383:0:6683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412807296:12345-192.168.206.27@tcp:3:cat.0 00000100:00100000:2.0:1790772152.628854:0:6683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412807296:12345-192.168.206.27@tcp:3:cat.0 Request processed in 470us (819us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790772152.628863:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00002000:00100000:2.0:1790772152.628871:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8df26f64b100 x1877760412807296/t0(0) o3->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:498/0 lens 488/4536 e 0 to 0 dl 1790772163 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790772152.628896:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df26f64b100 with x1877760412807296 ext(0->4095) 00002000:00010000:2.0:1790772152.628900:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df26f64b100 00000100:00100000:2.0:1790772152.800305:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772152.800334:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b0ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428543744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772152.800422:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772152.800576:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428543744 00000100:00100000:3.0:1790772152.800587:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428543744 00000100:00100000:3.0:1790772152.800683:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790772152.800696:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428543744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772152.800754:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772152.800810:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428543744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772152.800818:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1790772152.801066:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772152.801101:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1790772152.801107:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1790772152.801132:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df26f3e8a80, transno 4294967301 00000004:00080000:2.0:1790772152.801151:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1790772152.801163:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df27abece00, transno 4294967304 00000100:00100000:2.0:1790772152.801175:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b0ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428543744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772152.801532:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428544256:0@lo:400:kworker.0 00000100:00100000:2.0:1790772152.801599:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772152.801638:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772152.801643:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428544128:0@lo:400:kworker.0 00000100:00100000:2.0:1790772152.801694:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772152.801726:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428544256 00000100:00100000:0.0:1790772152.801872:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428544000:0@lo:400:kworker.0 00000100:00100000:0.0:1790772152.801905:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772152.801927:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790772152.801933:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428543872:0@lo:400:kworker.0 00000100:00100000:0.0:1790772152.801971:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772152.801994:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428544384:0@lo:400:kworker.0 00000100:00100000:0.0:1790772152.802023:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772152.802053:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428544128 00000100:00100000:0.0:1790772152.802057:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428544128 00000100:00100000:0.0:1790772152.802102:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428544000 00000100:00100000:0.0:1790772152.802105:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428544000 00000100:00100000:0.0:1790772152.802120:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790772152.802128:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428544128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772152.802181:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428544128:12345-0@lo:400:kworker.0 Request processed in 52us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772152.802188:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790772152.802206:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790772152.802212:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428544000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772152.802245:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428544000:12345-0@lo:400:kworker.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772152.802251:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790772152.802269:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428543872 00000100:00100000:0.0:1790772152.802273:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428543872 00000100:00100000:0.0:1790772152.802299:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1790772152.802306:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428543872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772152.802336:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428543872:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772152.802359:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1790772152.802387:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428544384 00000100:00100000:0.0:1790772152.802391:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428544384 00000100:00100000:0.0:1790772152.802412:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790772152.802419:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1877760428544384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772152.802449:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1877760428544384:12345-0@lo:400:kworker.0 Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772152.802455:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1790772152.802476:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772152.802502:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428544128:0@lo:400:kworker.0 00000100:00100000:0.0:1790772152.802528:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428543872:0@lo:400:kworker.0 00000100:00100000:0.0:1790772152.802538:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428544384:0@lo:400:kworker.0 00000100:00100000:0.0:1790772152.802570:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428544000:0@lo:400:kworker.0 00000100:00100000:2.0:1790772152.802871:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428544256 00000100:00100000:2.0:1790772152.802919:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790772152.802927:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428544256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772152.803031:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428544256:12345-0@lo:400:kworker.0 Request processed in 105us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772152.803038:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790772152.803070:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428544256:0@lo:400:kworker.0 00000100:00080000:0.0:1790772152.804873:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772152.873657:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772152.873725:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772152.873753:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412807552 00000100:00100000:3.0:1790772152.873767:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412807552 00000100:00100000:1.0:1790772152.873771:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412807808 00000100:00100000:0.0:1790772152.873777:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772152.873783:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412807808 00000100:00100000:0.0:1790772152.873819:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772152.873859:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412807424 00000100:00100000:1.0:1790772152.873863:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412807680 00000100:00100000:3.0:1790772152.873865:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 138 00000100:00100000:0.0:1790772152.873869:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772152.873871:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412807424 00000100:00100000:1.0:1790772152.873871:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412807680 00000100:00100000:3.0:1790772152.873902:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:2349:x1877760412807552:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772152.873918:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00100000:0.0:1790772152.873931:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2349:x1877760412807808:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772152.874003:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:2349:x1877760412807552:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 108us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772152.874012:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 138 00000100:00100000:3.0:1790772152.874031:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412807936 00000100:00100000:3.0:1790772152.874035:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412807936 00000100:00100000:3.0:1790772152.874062:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 139 00000100:00100000:3.0:1790772152.874067:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412807936:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772152.874193:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 287 00000100:00100000:1.0:1790772152.874215:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:2.0:1790772152.874222:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2349:x1877760412807424:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772152.874235:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2349:x1877760412807680:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772152.875943:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2349:x1877760412807808:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 2002us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772152.875959:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00080000:0.0:1790772152.876061:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772152.876068:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772152.880671:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412807936:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 6589us (6791us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772152.880698:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 139 00000100:00100000:2.0:1790772152.884114:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2349:x1877760412807424:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 9901us (10331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772152.884125:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2349:x1877760412807680:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 9883us (10293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772152.884138:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 287 00000100:00100000:1.0:1790772152.884153:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:0.0:1790772153.311852:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428544512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772153.311926:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772153.312118:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428544512 00000100:00100000:1.0:1790772153.312126:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428544512 00000100:00100000:1.0:1790772153.312189:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790772153.312199:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1877760428544512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772153.312235:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772153.312282:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1877760428544512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772153.312288:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1790772153.312408:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772153.312446:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428544512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772153.377705:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772154.401528:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772155.423908:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790772156.425225:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1790772156.425244:0:5845:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df247cc1180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1790772156.425249:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df24401e700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df250bc3f00 00000020:00080000:0.0:1790772156.425253:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df24401ea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df27f8b8800 00000020:00080000:0.0:1790772156.425266:0:5845:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1790772156.425271:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1790772156.425298:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1790772156.425467:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1790772156.443634:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1790772156.443651:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:2.0:1790772156.447761:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772157.483584:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772157.584326:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772157.584526:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412808064 00000100:00100000:2.0:1790772157.584539:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412808064 00000100:00100000:2.0:1790772157.584684:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 135 00000100:00100000:2.0:1790772157.584696:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10225:x1877760412808064:12345-192.168.206.27@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790772157.584841:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10225:x1877760412808064:12345-192.168.206.27@tcp:60:lhsmtool_posix.0 Request processed in 147us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772157.584850:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 135 00000100:00080000:0.0:1790772157.585034:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772157.587015:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772157.587122:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412808320 00000100:00100000:1.0:1790772157.587134:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412808320 00000100:00100000:1.0:1790772157.587193:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:1.0:1790772157.587203:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:10225:x1877760412808320:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790772157.587829:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:10225:x1877760412808320:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 624us (825us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1790772157.587840:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:2.0:1790772157.919850:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428544896:0@lo:400:kworker.0 00000100:00100000:2.0:1790772157.919946:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772157.920026:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772157.920033:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428545024:0@lo:400:kworker.0 00000100:00100000:2.0:1790772157.920066:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772157.920114:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428545024 00000100:00100000:2.0:1790772157.920124:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428545024 00000100:00100000:2.0:1790772157.920211:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790772157.920221:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428545024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772157.920291:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428545024:12345-0@lo:400:kworker.0 Request processed in 60us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772157.920299:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790772157.920344:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428545024:0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.920700:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428544768:0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.920737:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772157.920773:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428545280:0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.920798:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772157.920818:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790772157.920824:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428544640:0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.920856:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772157.920892:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428545152:0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.920917:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772157.920962:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428544640 00000100:00100000:1.0:1790772157.920967:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428544640 00000100:00100000:1.0:1790772157.921002:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1790772157.921010:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428544640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.921051:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428544640:12345-0@lo:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772157.921058:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1790772157.921096:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428544640:0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.921119:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428544896 00000100:00100000:1.0:1790772157.921123:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428544896 00000100:00100000:1.0:1790772157.921318:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428544768 00000100:00100000:1.0:1790772157.921323:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428544768 00000100:00100000:1.0:1790772157.921335:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428545152 00000100:00100000:1.0:1790772157.921338:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428545152 00000100:00100000:1.0:1790772157.921353:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790772157.921360:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428544896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.921405:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428544896:12345-0@lo:400:kworker.0 Request processed in 44us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772157.921412:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790772157.921424:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790772157.921430:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428544768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.921463:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428544768:12345-0@lo:400:kworker.0 Request processed in 33us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772157.921469:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790772157.921480:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790772157.921495:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428545152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.921527:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428545152:12345-0@lo:400:kworker.0 Request processed in 33us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772157.921534:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790772157.921619:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428545152:0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.921630:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428544768:0@lo:400:kworker.0 00000100:00100000:1.0:1790772157.921674:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428544896:0@lo:400:kworker.0 00000100:00100000:0.0:1790772157.923473:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428545280 00000100:00100000:0.0:1790772157.923490:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428545280 00000100:00100000:0.0:1790772157.923615:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790772157.923628:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428545280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772157.923755:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428545280:12345-0@lo:400:kworker.0 Request processed in 130us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772157.923763:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1790772157.923797:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772157.923802:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772157.923805:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772157.924345:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772157.924364:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428545408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772157.924417:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772157.924460:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428545408 00000100:00100000:3.0:1790772157.924466:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428545408 00000100:00100000:3.0:1790772157.924501:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790772157.924509:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428545408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772157.924545:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772157.924613:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428545408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772157.924619:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790772157.924807:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428545408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772157.926082:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1790772157.926093:0:3296:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df26f8d6300, transno 4294967310 00000004:00080000:1.0:1790772157.926115:0:3296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1790772157.926156:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428545280:0@lo:400:kworker.0 00000100:00100000:3.0:1790772157.991439:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772157.991515:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772157.991611:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772157.991637:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772157.991686:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772157.991720:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412808832 00000100:00100000:3.0:1790772157.991734:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412808832 00000100:00100000:3.0:1790772157.991813:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412808704 00000100:00100000:3.0:1790772157.991817:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412808704 00000100:00100000:3.0:1790772157.991845:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:3.0:1790772157.991856:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412808832:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772157.991954:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412808832:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 99us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772157.991963:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:3.0:1790772157.991982:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 71 00000100:00100000:3.0:1790772157.991989:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412808704:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772157.992016:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412808704:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 27us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772157.992023:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 71 00000100:00080000:3.0:1790772157.992045:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772157.992050:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772157.993091:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412808448 00000100:00100000:0.0:1790772157.993102:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412808448 00000100:00100000:0.0:1790772157.993171:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 289 00000100:00100000:0.0:1790772157.993180:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412808448:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772157.993255:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412808448:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 76us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772157.993264:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 289 00000100:00100000:1.0:1790772157.993502:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412808576 00000100:00100000:1.0:1790772157.993508:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412808576 00000100:00100000:1.0:1790772157.993584:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412808960 00000100:00100000:1.0:1790772157.993589:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412808960 00000100:00100000:1.0:1790772157.993625:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 143 00000100:00100000:1.0:1790772157.993633:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:2348:x1877760412808576:12345-192.168.206.27@tcp:400:kworker.0 00000100:00080000:3.0:1790772157.993674:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772157.993708:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:2348:x1877760412808576:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 76us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772157.993715:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 143 00000100:00100000:1.0:1790772157.993732:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 144 00000100:00100000:1.0:1790772157.993738:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412808960:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772157.993764:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412808960:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 27us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772157.993791:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 144 00000100:00100000:3.0:1790772158.433125:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428545536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772158.433236:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772158.433578:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428545536 00000100:00100000:1.0:1790772158.433589:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428545536 00000100:00100000:1.0:1790772158.433666:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790772158.433677:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428545536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772158.433725:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772158.433797:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428545536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772158.433805:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790772158.433910:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428545536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790772158.496017:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772159.455009:0:12233:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:42:37 (1790772157) 00010000:00010000:2.0:1790772159.521813:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772160.546577:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772160.844911:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772160.845775:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412809216 00000100:00100000:2.0:1790772160.845791:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412809216 00000100:00100000:2.0:1790772160.845980:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 136 00000100:00100000:2.0:1790772160.845997:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:11273:x1877760412809216:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772160.846024:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772160.846050:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a907b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226bb6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846146:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a907c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846163:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a907c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846176:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a907c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846194:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a907c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846201:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a907c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846227:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a907c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846525:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a907ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846536:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a907ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846543:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a907ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772160.846604:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790772160.846722:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a907c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846731:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a907c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846739:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a907c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846745:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772160.846750:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a907c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846759:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a907c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846772:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df254043600) 00010000:00010000:2.0:1790772160.846776:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772160.846789:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a907c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846796:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a907c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846809:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a907c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846815:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a907c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846821:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a907c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846826:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aae00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772160.846829:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a907c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846835:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a907c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846844:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df25a490e00) 00010000:00010000:2.0:1790772160.846847:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772160.846849:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a907c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.846855:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a907c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.847311:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a907b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bb6 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.847340:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a907ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bb6 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772160.847347:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:2.0:1790772160.847350:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772160.847352:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab600, rc 0) 00000100:00100000:2.0:1790772160.847441:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:11273:x1877760412809216:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1451us (2539us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1790772160.847450:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 136 00000100:00080000:3.0:1790772160.848749:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772160.851105:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772160.851778:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412809344 00000100:00100000:2.0:1790772160.851790:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412809344 00000100:00100000:2.0:1790772160.852406:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 137 00000100:00100000:2.0:1790772160.852422:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:11273:x1877760412809344:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790772160.852611:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:11273:x1877760412809344:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 Request processed in 193us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772160.852620:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 137 00000100:00100000:3.0:1790772160.853478:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772160.853594:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412809472 00000100:00100000:1.0:1790772160.853603:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412809472 00000100:00100000:1.0:1790772160.853669:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:1.0:1790772160.853679:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+17:2349:x1877760412809472:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772160.853711:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772160.853741:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a907ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bb6 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772160.853762:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:1.0:1790772160.853767:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772160.853810:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:2349:x1877760412809472:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 132us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772160.853817:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000020:00080000:1.0:1790772161.565840:0:5845:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1790772161.565872:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000001:00080000:1.0:1790772161.565881:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1790772161.565895:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1790772161.566777:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1790772161.570074:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772161.573025:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772161.573034:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772161.575126:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1790772161.575138:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790772162.592097:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772162.773151:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772162.773263:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412809600 00000100:00100000:1.0:1790772162.773277:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412809600 00000100:00100000:1.0:1790772162.773371:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 138 00000100:00100000:1.0:1790772162.773383:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:11315:x1877760412809600:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772162.773409:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772162.773435:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a907dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226bbd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.773516:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a907e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.773533:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a907e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.773546:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a907e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774259:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a907ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774271:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a907ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774281:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a907ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774521:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a907e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774530:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a907e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774545:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a907e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774592:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772162.774598:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a907e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774608:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a907e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774632:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57200) 00010000:00010000:1.0:1790772162.774637:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772162.774643:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a907e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774651:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a907e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774662:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a907ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774670:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a907ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.774675:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a907ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790772162.774805:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790772162.775776:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772162.775784:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a907ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.775808:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a907ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.775823:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df27c001200) 00010000:00010000:1.0:1790772162.775826:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772162.775830:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a907ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.775838:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a907ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.776321:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a907dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bbd expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.776336:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57200) 00010000:00010000:1.0:1790772162.776339:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772162.776344:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a907dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bbd expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.776355:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9800, rc 0) 00000100:00100000:1.0:1790772162.776458:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:11315:x1877760412809600:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 3075us (3320us total) trans 0 rc 301/301 00000100:00100000:1.0:1790772162.776468:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 138 00000100:00100000:1.0:1790772162.783515:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772162.784162:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412809856 00000100:00100000:0.0:1790772162.784176:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412809856 00000100:00100000:0.0:1790772162.784257:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 139 00000100:00100000:0.0:1790772162.784269:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:11315:x1877760412809856:12345-192.168.206.27@tcp:36:lfs.0 00010000:00010000:0.0:1790772162.784483:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772162.784526:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90168 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269fd expref: 14 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.784544:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df251c57200) 00010000:00010000:0.0:1790772162.784574:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772162.785126:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a907f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.785144:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a907f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.785166:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a907f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.785179:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.785187:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.785193:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772162.786872:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790772162.786893:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a907f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.786904:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a907f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.786913:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a907f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.786920:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772162.786925:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a907f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.786934:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a907f1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.786952:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df254043c00) 00010000:00010000:0.0:1790772162.786955:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772162.786967:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a907f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.786975:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a907f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772162.786997:0:6701:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a49a3889 reply state 00000000de9e91ef transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772162.787007:0:6701:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772162.787227:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:11315:x1877760412809856:12345-192.168.206.27@tcp:36:lfs.0 Request processed in 2955us (3719us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1790772162.787237:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 139 00010000:00010000:1.0:1790772162.791178:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.791202:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.791226:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.791233:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772162.791239:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.791249:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.791270:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df254043300) 00010000:00010000:1.0:1790772162.791273:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772162.791279:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.791286:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a907f8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772162.883451:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772162.883531:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412809984 00000100:00100000:2.0:1790772162.883569:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412809984 00000100:00100000:2.0:1790772162.883657:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 140 00000100:00100000:2.0:1790772162.883670:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:11323:x1877760412809984:12345-192.168.206.27@tcp:101:lctl.0 00010000:00010000:2.0:1790772162.883706:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772162.883738:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a907ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226bc4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.883844:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90806 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.883870:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90806 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.883886:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90806 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772162.883938:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772162.883944:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772162.883975:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90806 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.884008:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a907ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bc4 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.884027:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90806 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bc4 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.884039:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25a490700) 00010000:00010000:2.0:1790772162.884043:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772162.884047:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab800, rc 0) 00000100:00100000:2.0:1790772162.884142:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:11323:x1877760412809984:12345-192.168.206.27@tcp:101:lctl.0 Request processed in 474us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772162.884151:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 140 00000100:00100000:3.0:1790772162.957369:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772162.957474:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412810112 00000100:00100000:1.0:1790772162.957486:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412810112 00000100:00100000:1.0:1790772162.957585:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 141 00000100:00100000:1.0:1790772162.957598:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+15:11329:x1877760412810112:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1790772162.957637:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772162.957663:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9080d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226bcb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.957849:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90814 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.957890:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90814 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.957966:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90814 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.957986:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9081b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.957994:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9081b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958000:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9081b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958122:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9e00/0xdf68d9a7d6a90822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958130:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9e00/0xdf68d9a7d6a90822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958137:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9e00/0xdf68d9a7d6a90822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772162.958169:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790772162.958173:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772162.958196:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9e00/0xdf68d9a7d6a90822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958209:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90814 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958226:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90814 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958233:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90814 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958240:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772162.958245:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90814 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958255:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90814 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958268:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25a490700) 00010000:00010000:1.0:1790772162.958272:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772162.958278:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90814 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958285:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90814 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958299:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9081b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958305:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9081b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958311:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9081b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958317:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772162.958325:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9081b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958331:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9081b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958339:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df27c001200) 00010000:00010000:1.0:1790772162.958342:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772162.958345:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9081b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958351:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9081b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958386:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9080d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bcb expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958399:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9e00/0xdf68d9a7d6a90822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bcb expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.958406:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:1.0:1790772162.958408:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790772162.958411:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9e00, rc 0) 00000100:00100000:1.0:1790772162.958667:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:11329:x1877760412810112:12345-192.168.206.27@tcp:101:bash.0 Request processed in 1070us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772162.958675:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 141 00000100:00100000:3.0:1790772162.965031:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772162.965091:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412810368 00000100:00100000:1.0:1790772162.965104:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412810368 00000100:00100000:1.0:1790772162.965179:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 142 00000100:00100000:1.0:1790772162.965255:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+16:11329:x1877760412810368:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1790772162.965301:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772162.965327:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90829 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226bd2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.965491:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90830 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.965507:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.965519:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.965533:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.965539:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772162.965545:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772162.966431:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1790772162.967061:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967079:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967289:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967338:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967346:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90830 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967354:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90830 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967361:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772162.967376:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90830 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967385:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90830 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967399:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772162.967402:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772162.967408:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90830 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967415:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90830 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772162.967431:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007ce11f19 reply state 00000000c0982bbe transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772162.967441:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790772162.967483:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90829 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd2 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967499:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd2 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.967506:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df254043c00) 00010000:00010000:0.0:1790772162.967509:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772162.967511:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d8200, rc 0) 00000100:00100000:0.0:1790772162.967855:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:11329:x1877760412810368:12345-192.168.206.27@tcp:101:bash.0 Request processed in 2657us (2829us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1790772162.967865:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 142 00010000:00010000:3.0:1790772162.970042:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772162.970062:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772162.970071:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772162.970078:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772162.970084:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772162.970092:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772162.970109:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df27c001300) 00010000:00010000:3.0:1790772162.970112:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772162.970117:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772162.970123:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90837 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772162.973026:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772162.974010:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412810496 00000100:00100000:3.0:1790772162.974028:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412810496 00000100:00100000:3.0:1790772162.974132:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:3.0:1790772162.974146:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412810496:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1790772162.974170:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1790772162.974783:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790772162.975021:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a9084c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226bd9 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772162.975060:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772162.975087:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1790772162.975092:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772162.975106:0:6678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a9084c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd9 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772162.975132:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a9084c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd9 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772162.975148:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3200, rc 0) 00000100:00100000:3.0:1790772162.975239:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412810496:12345-192.168.206.27@tcp:101:bash.0 Request processed in 1096us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772162.975248:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:2.0:1790772162.977985:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772162.978059:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412810624 00000100:00100000:0.0:1790772162.978072:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412810624 00000100:00100000:0.0:1790772162.978150:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:0.0:1790772162.978161:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:11329:x1877760412810624:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1790772162.978184:0:8509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772162.978208:0:8509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226be0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.978246:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a9084c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd9 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.978256:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772162.978261:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772162.978268:0:8509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 7 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.978310:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a9084c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd9 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.978324:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a9084c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd9 expref: 7 pid: 6678 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772162.978341:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f64ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8509:1877760428545664:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772162.978535:0:8509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2492259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772162.981142:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772162.981142:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f64ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8509:1877760428545664:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772162.981182:0:8509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 7 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772162.981229:0:8509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9000, rc 0) 00000100:00100000:0.0:1790772162.981305:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:11329:x1877760412810624:12345-192.168.206.27@tcp:101:bash.0 Request processed in 3144us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772162.981315:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:2.0:1790772162.982315:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412810752 00000100:00100000:2.0:1790772162.982327:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412810752 00010000:00010000:2.0:1790772162.982374:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a9084c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd9 expref: 7 pid: 6678 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772162.982490:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:2.0:1790772162.982501:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412810752:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772162.982520:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772162.982579:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a9084c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd9 expref: 7 pid: 6678 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.982595:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a9084c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd9 expref: 7 pid: 6678 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.982632:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a9084c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd9 expref: 7 pid: 6678 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.982650:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772162.982655:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772162.982664:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 6 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.982676:0:5808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 6 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772162.982731:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 6 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772162.982747:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f8d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1877760428545792:192.168.206.27@tcp:105: 00000100:00100000:2.0:1790772162.982841:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772162.987003:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772162.987100:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412811008 00000100:00100000:1.0:1790772162.987110:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412811008 00000100:00100000:2.0:1790772162.987111:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f8d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1877760428545792:192.168.206.27@tcp:105: 00010000:00010000:2.0:1790772162.987139:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772162.987218:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:1.0:1790772162.987230:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+18:11329:x1877760412811008:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:2.0:1790772162.987267:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412810752:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 4767us (6138us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772162.987277:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:1.0:1790772162.987656:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:11329:x1877760412811008:12345-192.168.206.27@tcp:35:bash.0 Request processed in 427us (665us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1790772162.987692:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:2.0:1790772163.042315:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428545920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772163.042424:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772163.042812:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428545920 00000100:00100000:3.0:1790772163.042822:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428545920 00000100:00100000:3.0:1790772163.042887:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790772163.042911:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428545920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772163.042976:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772163.043009:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df24319ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428546432:0@lo:400:kworker.0 00000100:00100000:3.0:1790772163.043031:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428545920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772163.043039:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790772163.043044:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790772163.043069:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772163.043099:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428545920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772163.043118:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790772163.043124:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428546048:0@lo:400:kworker.0 00000100:00100000:0.0:1790772163.043156:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772163.043262:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df24319b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428546560:0@lo:400:kworker.0 00000100:00100000:0.0:1790772163.043290:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772163.043319:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428546176:0@lo:400:kworker.0 00000100:00100000:1.0:1790772163.043484:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df243199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428546304:0@lo:400:kworker.0 00000100:00100000:3.0:1790772163.043505:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428546048 00000100:00100000:3.0:1790772163.043510:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428546048 00000100:00100000:3.0:1790772163.043581:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1790772163.043590:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428546048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772163.047700:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772163.047807:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428546432 00000100:00100000:1.0:1790772163.047818:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428546432 00000100:00100000:1.0:1790772163.047889:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428546304 00000100:00100000:1.0:1790772163.047893:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428546304 00000100:00100000:1.0:1790772163.047921:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790772163.048618:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790772163.048643:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428546304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772163.048754:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428546304:12345-0@lo:400:kworker.0 Request processed in 117us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772163.048762:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790772163.048823:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df243199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428546304:0@lo:400:kworker.0 00000100:00080000:2.0:1790772163.050080:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772163.050140:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772163.050238:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428546560 00000100:00100000:0.0:1790772163.050248:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428546560 00000100:00100000:2.0:1790772163.050270:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428546176 00000100:00100000:2.0:1790772163.050274:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428546176 00000100:00100000:2.0:1790772163.050309:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790772163.050309:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790772163.050319:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428546176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772163.050319:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428546560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772163.050396:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428546560:12345-0@lo:400:kworker.0 Request processed in 79us (7105us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772163.050403:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1790772163.050434:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772163.050466:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df24319b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428546560:0@lo:400:kworker.0 00000100:00100000:3.0:1790772163.050474:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428546048:12345-0@lo:400:kworker.0 Request processed in 6883us (7315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772163.050484:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1790772163.050511:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428546048:0@lo:400:kworker.0 00000100:00100000:1.0:1790772163.050667:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428546432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772163.050717:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428546432:12345-0@lo:400:kworker.0 Request processed in 2787us (7671us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772163.050724:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790772163.050868:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df24319ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428546432:0@lo:400:kworker.0 00000100:00100000:2.0:1790772163.053025:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428546176:12345-0@lo:400:kworker.0 Request processed in 2696us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772163.053041:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790772163.053162:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df25e305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428546176:0@lo:400:kworker.0 00000100:00100000:0.0:1790772163.082074:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772163.082395:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412811264 00000100:00100000:3.0:1790772163.082408:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412811264 00000100:00100000:3.0:1790772163.082516:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 143 00000100:00100000:3.0:1790772163.082527:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:11339:x1877760412811264:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772163.082635:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772163.082663:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9085a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226be7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772163.082779:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790772163.083285:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9085a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be7 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.083327:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25a490700) 00010000:00010000:2.0:1790772163.083331:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772163.083338:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a9085a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be7 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.083354:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3400, rc 0) 00000100:00100000:2.0:1790772163.083634:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:11339:x1877760412811264:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1096us (1617us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1790772163.083644:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 143 00000100:00100000:3.0:1790772163.086750:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.086872:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412811520 00000100:00100000:0.0:1790772163.086884:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412811520 00000100:00100000:0.0:1790772163.086968:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:0.0:1790772163.086978:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:11339:x1877760412811520:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772163.087943:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:11339:x1877760412811520:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 959us (1200us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1790772163.087962:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:0.0:1790772163.122493:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.122564:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.122683:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772163.122867:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412811648 00000100:00100000:2.0:1790772163.122880:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412811648 00000100:00100000:1.0:1790772163.122924:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412811776 00000100:00100000:1.0:1790772163.122928:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412811776 00000100:00100000:2.0:1790772163.122948:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 291 00000100:00100000:2.0:1790772163.122959:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412811648:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772163.122976:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00100000:1.0:1790772163.122983:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2350:x1877760412811776:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772163.123136:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2350:x1877760412811776:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 152us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772163.123144:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00080000:3.0:1790772163.123315:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772163.123331:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412811904 00000100:00100000:3.0:1790772163.123335:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412811904 00000100:00100000:3.0:1790772163.123390:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 148 00000100:00100000:3.0:1790772163.123398:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412811904:12345-192.168.206.27@tcp:400:kworker.0 00000100:00080000:0.0:1790772163.123483:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772163.129401:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412811648:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 6424us (6902us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772163.129421:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 291 00000100:00100000:3.0:1790772163.131633:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2349:x1877760412811904:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 8208us (8923us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772163.131650:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 148 00000100:00100000:0.0:1790772163.162730:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772163.162868:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412812032 00000100:00100000:2.0:1790772163.162882:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412812032 00000100:00100000:2.0:1790772163.162961:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 144 00000100:00100000:2.0:1790772163.162972:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:11345:x1877760412812032:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772163.163004:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772163.163460:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226bee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.163581:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9086f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.163616:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9086f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.163644:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9086f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772163.163687:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790772163.163691:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772163.163711:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9086f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.163743:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bee expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.163766:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9086f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bee expref: 22 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.163777:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:2.0:1790772163.163781:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772163.163785:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9abc00, rc 0) 00000100:00100000:2.0:1790772163.164361:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:11345:x1877760412812032:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1386us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772163.164372:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 144 00000100:00100000:0.0:1790772163.172352:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772163.172513:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412812288 00000100:00100000:2.0:1790772163.172528:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412812288 00000100:00100000:2.0:1790772163.172632:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 145 00000100:00100000:2.0:1790772163.172645:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25e305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:11345:x1877760412812288:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772163.172670:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772163.172711:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226bf5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.172834:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a9087d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.172850:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a9087d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.172863:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a9087d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772163.172875:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790772163.173342:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bf5 expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.173367:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a9087d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bf5 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.173377:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df254043c00) 00010000:00010000:2.0:1790772163.173380:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772163.173384:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa800, rc 0) 00000100:00100000:2.0:1790772163.173468:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25e305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:11345:x1877760412812288:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 826us (1132us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1790772163.173477:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 145 00000100:00100000:1.0:1790772163.180759:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.181041:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412812544 00000100:00100000:0.0:1790772163.181056:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412812544 00000100:00100000:0.0:1790772163.181138:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 146 00000100:00100000:0.0:1790772163.181150:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:11345:x1877760412812544:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772163.181183:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772163.181208:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9088b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226bfc expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.181345:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90892 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.181363:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.181376:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772163.181389:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790772163.181543:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8c00/0xdf68d9a7d6a9088b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bfc expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.181616:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bfc expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.181637:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df254043c00) 00010000:00010000:0.0:1790772163.181640:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790772163.181644:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f8d9600, rc 0) 00000100:00100000:0.0:1790772163.181794:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:11345:x1877760412812544:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 645us (1048us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1790772163.181804:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 146 00000100:00100000:3.0:1790772163.184828:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772163.185437:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412812672 00000100:00100000:1.0:1790772163.185450:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412812672 00000100:00100000:1.0:1790772163.185543:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:1.0:1790772163.185581:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:2349:x1877760412812672:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772163.185601:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772163.185659:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a9087d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bf5 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.185682:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df254043c00) 00010000:00010000:1.0:1790772163.185688:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772163.185768:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:2349:x1877760412812672:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 190us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772163.185776:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:3.0:1790772163.194008:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.195834:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412812800 00000100:00100000:0.0:1790772163.195854:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412812800 00000100:00100000:0.0:1790772163.195952:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:0.0:1790772163.195965:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412812800:12345-192.168.206.27@tcp:1:lfs.0 00010000:00010000:0.0:1790772163.196035:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.196086:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 6 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.196096:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772163.196101:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772163.196106:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.196154:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 6 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.196171:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 6 pid: 8509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772163.196190:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1877760428546688:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772163.196324:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df249225c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772163.198866:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1877760428546688:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772163.198901:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772163.201255:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772163.201366:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412812928 00000100:00100000:1.0:1790772163.201379:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412812928 00002000:00100000:1.0:1790772163.201440:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8df27af06a00 x1877760412812928/t0(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:509/0 lens 504/0 e 0 to 0 dl 1790772174 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772163.201452:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27af06a00 with x1877760412812928 ext(0->12) 00010000:00010000:1.0:1790772163.201465:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 7 pid: 8509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.201485:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 7 pid: 8509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772163.201494:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df27af06a00 00000100:00100000:1.0:1790772163.201535:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:1.0:1790772163.201545:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412812928:12345-192.168.206.27@tcp:4:lfs.0 00000100:00100000:1.0:1790772163.202767:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2347:x1877760412812928:12345-192.168.206.27@tcp:4:lfs.0 Request processed in 1212us (1514us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790772163.202782:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00002000:00100000:1.0:1790772163.202794:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8df27af06a00 x1877760412812928/t4294967305(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:509/0 lens 504/448 e 0 to 0 dl 1790772174 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772163.202814:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27af06a00 with x1877760412812928 ext(0->12) 00010000:00010000:1.0:1790772163.202825:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 9 pid: 8509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.202846:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 9 pid: 8509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772163.202854:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df27af06a00 00000100:00100000:3.0:1790772163.207132:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.207634:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412813056 00000100:00100000:0.0:1790772163.207648:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412813056 00010000:00010000:0.0:1790772163.207698:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 9 pid: 8509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772163.207825:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:0.0:1790772163.207838:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2347:x1877760412813056:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772163.207859:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790772163.207882:0:7617:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790772163.207885:0:7617:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790772162 00002000:00010000:0.0:1790772163.207888:0:7617:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790772162 00002000:00010000:0.0:1790772163.207890:0:7617:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790772162 00010000:00010000:0.0:1790772163.207909:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 9 pid: 8509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.207925:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 9 pid: 8509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.207953:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e51bec9/0xdf68d9a7d6a90853 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226be0 expref: 9 pid: 8509 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.207979:0:7617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772163.207984:0:7617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772163.207990:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.208001:0:7617:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.208053:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772163.208140:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412813056:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 305us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772163.208149:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 62 00010000:00010000:1.0:1790772163.208538:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.208587:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.208632:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.208643:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.208653:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.208660:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8c00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772163.208666:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.208686:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.208704:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.208713:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045bc6d65/0xdf68d9a7d6a908a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772163.208788:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412812800:12345-192.168.206.27@tcp:1:lfs.0 Request processed in 12824us (14793us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772163.208798:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:3.0:1790772163.215717:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772163.215869:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412813312 00000100:00100000:1.0:1790772163.215883:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412813312 00000100:00100000:1.0:1790772163.215959:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:1.0:1790772163.215970:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25db8d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:11345:x1877760412813312:12345-192.168.206.27@tcp:35:lfs.0 00000004:00010000:1.0:1790772163.216061:0:5827:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bfc expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772163.216420:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1790772163.216457:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1790772163.217637:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1790772163.217724:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.217746:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd2 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.217768:0:5827:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.217813:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd2 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.217833:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd2 expref: 29 pid: 5825 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772163.217849:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5827:1877760428546816:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772163.218252:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927b300 going to sleep for 11 seconds 00000100:00100000:3.0:1790772163.224235:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772163.224381:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412813440 00000100:00100000:2.0:1790772163.224394:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412813440 00010000:00010000:2.0:1790772163.224445:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd2 expref: 30 pid: 5825 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772163.224516:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:2.0:1790772163.224528:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:2348:x1877760412813440:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772163.224582:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772163.224591:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd2 expref: 30 pid: 5825 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.224606:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd2 expref: 30 pid: 5825 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.224645:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df254043c00) 00010000:00010000:2.0:1790772163.224652:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.224663:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.224671:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.224704:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772163.224768:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:2348:x1877760412813440:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 241us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772163.224776:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 63 00010000:00010000:1.0:1790772163.226205:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8200/0xdf68d9a7d6a9083e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bd2 expref: 29 pid: 5825 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772163.226236:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5827:1877760428546816:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772163.226268:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.226280:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.226287:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772163.226454:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1790772163.226768:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1790772163.228266:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428546944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790772163.228384:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772163.228473:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772163.232618:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428546944 00000100:00100000:0.0:1790772163.232651:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428546944 00000100:00100000:0.0:1790772163.232746:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790772163.232759:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5827:x1877760428546944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790772163.232936:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5827:x1877760428546944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 180us (4552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772163.232945:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790772163.234268:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428546944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790772163.235254:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1790772163.235369:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df24319ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428547072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790772163.235456:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772163.235493:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772163.235631:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428547072 00000100:00100000:0.0:1790772163.235640:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428547072 00000100:00100000:0.0:1790772163.235827:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772163.235839:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24319b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5827:x1877760428547072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790772163.236352:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24319b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5827:x1877760428547072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 513us (894us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790772163.236362:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772163.236539:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df24319ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877760428547072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790772163.236784:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1790772163.236833:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.236845:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.236855:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.236861:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772163.236867:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.236875:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.236891:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df254043c00) 00010000:00010000:2.0:1790772163.236894:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790772163.236912:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.236918:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a908a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790772163.237145:0:5827:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790772163.237261:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1790772163.237272:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329381722587ns, next at 330381720557ns, rc = 0 00000001:00080000:2.0:1790772163.237294:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1790772163.237331:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df254043c00) 00010000:00010000:2.0:1790772163.237334:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790772163.237343:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9600/0xdf68d9a7d6a90892 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bfc expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772163.237487:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25db8d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:11345:x1877760412813312:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 21518us (21785us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1790772163.237497:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00000020:00080000:2.0:1790772163.237502:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790772163.240086:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772163.240182:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412813568 00000100:00100000:1.0:1790772163.240194:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412813568 00000100:00100000:1.0:1790772163.240253:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 147 00000100:00100000:1.0:1790772163.240264:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:11345:x1877760412813568:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772163.240293:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772163.240322:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a908ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c03 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.240399:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a908ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c03 expref: 33 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.240430:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a908ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c03 expref: 33 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.240453:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:1.0:1790772163.240456:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790772163.240460:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8800, rc 0) 00000100:00100000:1.0:1790772163.240531:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:11345:x1877760412813568:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 269us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772163.240538:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 147 00000100:00100000:3.0:1790772163.243054:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.243137:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412813824 00000100:00100000:0.0:1790772163.243149:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412813824 00000100:00100000:0.0:1790772163.243218:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:0.0:1790772163.243229:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:11345:x1877760412813824:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772163.243586:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+34:11345:x1877760412813824:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 357us (543us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1790772163.243596:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:3.0:1790772163.321429:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.322707:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412814080 00000100:00100000:0.0:1790772163.322726:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412814080 00000100:00100000:0.0:1790772163.322814:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 148 00000100:00100000:0.0:1790772163.322843:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+34:11355:x1877760412814080:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772163.322878:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772163.322906:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204e400/0xdf68d9a7d6a908b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c0a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772163.323027:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790772163.323184:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204e400/0xdf68d9a7d6a908b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c0a expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.323202:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25a490700) 00010000:00010000:0.0:1790772163.323206:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772163.323212:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204e400/0xdf68d9a7d6a908b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c0a expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.323231:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df28204e400, rc 0) 00000100:00100000:0.0:1790772163.323329:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:11355:x1877760412814080:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 488us (1925us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1790772163.323338:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 148 00000100:00100000:3.0:1790772163.328747:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772163.335446:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412814208 00000100:00100000:1.0:1790772163.335467:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412814208 00000100:00100000:1.0:1790772163.335578:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 149 00000100:00100000:1.0:1790772163.335590:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:11355:x1877760412814208:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:1.0:1790772163.335703:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a908c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335741:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a908c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335755:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a908c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335772:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a908ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335779:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a908ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335786:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a908ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335891:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335899:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335905:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772163.335955:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335970:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a908c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335978:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a908c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.335997:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a908c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336003:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772163.336008:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a908c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336016:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a908c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336029:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:1.0:1790772163.336032:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772163.336037:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a908c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336044:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a908c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336058:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a908ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336065:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a908ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336071:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a908ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336076:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772163.336079:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a908ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336095:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a908ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336103:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df27c001400) 00010000:00010000:1.0:1790772163.336106:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772163.336109:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a908ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336115:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a908ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336131:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336137:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336142:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336147:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772163.336149:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336154:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336161:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:1.0:1790772163.336163:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772163.336165:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.336179:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772163.336280:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:11355:x1877760412814208:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 691us (7545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772163.336289:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 149 00000100:00100000:3.0:1790772163.338672:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.339423:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412814464 00000100:00100000:0.0:1790772163.339437:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412814464 00000100:00100000:0.0:1790772163.339513:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:0.0:1790772163.339526:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:11355:x1877760412814464:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772163.339880:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:11355:x1877760412814464:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 355us (1218us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1790772163.339890:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:3.0:1790772163.379375:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.379524:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412814720 00000100:00100000:0.0:1790772163.379590:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412814720 00000100:00100000:0.0:1790772163.379675:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 150 00000100:00100000:0.0:1790772163.379688:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:11358:x1877760412814720:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772163.379722:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772163.379747:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204e400/0xdf68d9a7d6a908d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c11 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.379843:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204f600/0xdf68d9a7d6a908df lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.379863:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204f600/0xdf68d9a7d6a908df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.379875:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204f600/0xdf68d9a7d6a908df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.379903:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a908e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.379911:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a908e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.379917:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a908e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380060:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380070:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380078:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772163.380098:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790772163.380239:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204f600/0xdf68d9a7d6a908df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380249:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204f600/0xdf68d9a7d6a908df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380257:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204f600/0xdf68d9a7d6a908df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380264:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df28204f600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772163.380269:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204f600/0xdf68d9a7d6a908df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380277:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204f600/0xdf68d9a7d6a908df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380290:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772163.380294:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772163.380300:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204f600/0xdf68d9a7d6a908df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380306:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204f600/0xdf68d9a7d6a908df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380322:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a908e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380327:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a908e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380344:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a908e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380349:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772163.380352:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a908e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380358:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a908e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380366:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df254043400) 00010000:00010000:0.0:1790772163.380368:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772163.380371:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a908e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380376:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a908e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380438:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df28204e400/0xdf68d9a7d6a908d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c11 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380455:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c11 expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.380462:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:0.0:1790772163.380464:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772163.380467:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030e00, rc 0) 00000100:00100000:0.0:1790772163.380599:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+38:11358:x1877760412814720:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 866us (1192us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1790772163.380618:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 150 00000100:00100000:3.0:1790772163.383967:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772163.384099:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412814848 00000100:00100000:1.0:1790772163.384111:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412814848 00000100:00100000:1.0:1790772163.384203:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 151 00000100:00100000:1.0:1790772163.384214:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+38:11358:x1877760412814848:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:1.0:1790772163.384309:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.384331:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.384343:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.384372:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.384380:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.384386:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.384393:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772163.384397:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.384422:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.384436:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:1.0:1790772163.384439:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772163.384444:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.384451:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a908fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772163.384591:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+38:11358:x1877760412814848:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 339us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772163.384599:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 151 00000100:00100000:3.0:1790772163.388943:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.389063:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412815104 00000100:00100000:0.0:1790772163.389076:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412815104 00000100:00100000:0.0:1790772163.389145:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:0.0:1790772163.389165:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+38:11358:x1877760412815104:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772163.389493:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+39:11358:x1877760412815104:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 316us (550us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1790772163.389502:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:2.0:1790772163.552747:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772163.554986:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428547200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772163.555098:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772163.555610:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428547200 00000100:00100000:3.0:1790772163.555636:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428547200 00000100:00100000:3.0:1790772163.555711:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790772163.555723:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428547200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772163.555769:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772163.555832:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428547200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772163.555839:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790772163.556033:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428547200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790772163.615962:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772163.656116:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772163.660518:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412815360 00000100:00100000:0.0:1790772163.660540:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412815360 00000100:00100000:0.0:1790772163.660800:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 152 00000100:00100000:0.0:1790772163.660813:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+39:11389:x1877760412815360:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:0.0:1790772163.660848:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772163.660877:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90902 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c18 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.661006:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a90909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.661024:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a90909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.661037:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a90909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772163.661050:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790772163.661218:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90902 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c18 expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.661268:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a90909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c18 expref: 41 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772163.661278:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:0.0:1790772163.661281:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772163.661285:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031a00, rc 0) 00000100:00100000:0.0:1790772163.662170:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:11389:x1877760412815360:12345-192.168.206.27@tcp:101:cat.0 Request processed in 1353us (6063us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1790772163.662182:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 152 00000100:00100000:3.0:1790772163.667948:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772163.668081:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772163.668524:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412815744 00000100:00100000:2.0:1790772163.668538:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412815744 00000100:00100000:2.0:1790772163.668674:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:2.0:1790772163.668687:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:2347:x1877760412815744:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772163.668707:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772163.668738:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a90909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c18 expref: 41 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.668763:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:2.0:1790772163.668769:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772163.668902:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+40:2347:x1877760412815744:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 217us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772163.668912:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1790772163.670917:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412815616 00000100:00100000:0.0:1790772163.670934:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412815616 00000100:00100000:0.0:1790772163.671004:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:0.0:1790772163.671016:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+40:11389:x1877760412815616:12345-192.168.206.27@tcp:35:cat.0 00000100:00100000:0.0:1790772163.671814:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:11389:x1877760412815616:12345-192.168.206.27@tcp:35:cat.0 Request processed in 796us (3887us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1790772163.671824:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:3.0:1790772163.750487:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772163.750670:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412816000 00000100:00100000:1.0:1790772163.750683:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412816000 00000100:00100000:1.0:1790772163.750758:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 153 00000100:00100000:1.0:1790772163.750769:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:11395:x1877760412816000:12345-192.168.206.27@tcp:101:dd.0 00010000:00010000:1.0:1790772163.750802:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772163.750806:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790772163.750844:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a9086f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bee expref: 41 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.750868:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:1.0:1790772163.750873:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772163.750890:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90917 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c1f expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.751034:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.751051:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c11 expref: 41 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.751061:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.751101:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c11 expref: 41 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.751115:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c11 expref: 41 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772163.751130:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428547328:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772163.751353:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927b780 going to sleep for 11 seconds 00000100:00100000:1.0:1790772163.754255:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428547328:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772163.754947:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772163.754967:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772163.755080:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412816128 00000100:00100000:2.0:1790772163.755089:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412816128 00010000:00010000:2.0:1790772163.755155:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c11 expref: 42 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772163.755199:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:2.0:1790772163.755210:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246094050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+42:2348:x1877760412816128:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772163.755229:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772163.755237:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c11 expref: 42 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.755512:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c11 expref: 42 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.755544:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a908ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c11 expref: 42 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.755591:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:2.0:1790772163.755597:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.755608:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.755629:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.755658:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772163.755806:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246094050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:2348:x1877760412816128:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 596us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772163.755838:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 64 00010000:00010000:1.0:1790772163.757328:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.757345:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772163.757375:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790772163.757645:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90917 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c1f expref: 42 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.757668:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c1f expref: 41 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.757678:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:1.0:1790772163.757681:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772163.757685:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9800, rc 0) 00000100:00100000:1.0:1790772163.757756:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:11395:x1877760412816000:12345-192.168.206.27@tcp:101:dd.0 Request processed in 6988us (7283us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1790772163.757765:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 153 00000100:00100000:3.0:1790772163.762025:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772163.762215:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412816384 00000100:00100000:2.0:1790772163.762228:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412816384 00000100:00100000:2.0:1790772163.762310:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 154 00000100:00100000:2.0:1790772163.762322:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:11395:x1877760412816384:12345-192.168.206.27@tcp:36:dd.0 00010000:00010000:2.0:1790772163.762681:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.762702:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772163.762714:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772163.762773:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1790772163.762799:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ce9cfa7d reply state 000000006575df44 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772163.762808:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772163.762914:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+44:11395:x1877760412816384:12345-192.168.206.27@tcp:36:dd.0 Request processed in 594us (901us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1790772163.762922:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 154 00000020:00080000:2.0:1790772163.762928:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790772163.767107:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.767130:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.767140:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.767147:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aac00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772163.767154:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.767163:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.767183:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:1.0:1790772163.767186:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772163.767213:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772163.767220:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a9092c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772164.104812:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772164.105478:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412816512 00000100:00100000:2.0:1790772164.105492:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412816512 00000100:00100000:2.0:1790772164.105614:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 155 00000100:00100000:2.0:1790772164.105636:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+43:11409:x1877760412816512:12345-192.168.206.27@tcp:101:stat.0 00010000:00010000:2.0:1790772164.105668:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772164.105716:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90933 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c26 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.105806:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9093a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.105824:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9093a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.105840:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9093a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.105856:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.105864:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.105871:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.106370:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.106387:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c1f expref: 44 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.106396:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.106444:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c1f expref: 44 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.106474:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c1f expref: 44 pid: 6701 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772164.106491:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b0ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428547456:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772164.106649:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27fcfacc0 going to sleep for 11 seconds 00000100:00080000:0.0:1790772164.109256:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772164.109541:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772164.110444:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b0ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428547456:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772164.110479:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772164.110512:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412816768 00000100:00100000:0.0:1790772164.110520:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412816768 00000100:00100000:0.0:1790772164.110885:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:0.0:1790772164.110897:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+45:5587:x1877760412816768:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790772164.111338:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+46:5587:x1877760412816768:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 441us (1803us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1790772164.111347:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:3.0:1790772164.114294:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772164.114457:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412816896 00000100:00100000:2.0:1790772164.114469:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412816896 00010000:00010000:2.0:1790772164.114518:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c1f expref: 46 pid: 6701 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772164.114596:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00100000:2.0:1790772164.114607:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+46:2348:x1877760412816896:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772164.114639:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772164.114647:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c1f expref: 46 pid: 6701 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.114661:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c1f expref: 46 pid: 6701 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.114761:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9091e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c1f expref: 46 pid: 6701 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.114781:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:2.0:1790772164.114787:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.114820:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.114829:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.114870:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772164.115035:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115045:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772164.115096:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790772164.115101:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772164.115123:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772164.115353:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+45:2348:x1877760412816896:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 747us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772164.115362:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 65 00010000:00010000:0.0:1790772164.115405:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115420:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9093a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115428:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9093a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115435:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9093a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115440:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abe00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772164.115445:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9093a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115452:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9093a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115473:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772164.115475:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772164.115480:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9093a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115487:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a9093a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115498:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115504:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90941 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115510:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115516:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aae00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772164.115518:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115524:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90941 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115531:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df25a490e00) 00010000:00010000:0.0:1790772164.115533:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772164.115536:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90941 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115542:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115662:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90933 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c26 expref: 45 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115685:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c26 expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.115693:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:0.0:1790772164.115696:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772164.115698:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab200, rc 0) 00000100:00100000:0.0:1790772164.115728:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+44:11409:x1877760412816512:12345-192.168.206.27@tcp:101:stat.0 Request processed in 10096us (10931us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772164.115736:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 155 00000100:00100000:3.0:1790772164.175274:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772164.175475:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412817152 00000100:00100000:2.0:1790772164.175487:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412817152 00000100:00100000:2.0:1790772164.175607:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 156 00000100:00100000:2.0:1790772164.175635:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+44:11415:x1877760412817152:12345-192.168.206.27@tcp:36:truncate.0 00010000:00010000:2.0:1790772164.175723:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772164.175955:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c26 expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.175981:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:2.0:1790772164.175988:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772164.176258:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.176275:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.176287:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772164.176370:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1790772164.176397:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dcb5e377 reply state 00000000c34ff0cd transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772164.176408:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772164.176695:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+46:11415:x1877760412817152:12345-192.168.206.27@tcp:36:truncate.0 Request processed in 1075us (1435us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1790772164.176703:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 156 00000020:00080000:2.0:1790772164.176709:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790772164.189040:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.189061:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.189070:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.189076:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772164.189082:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.189090:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.189109:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:1.0:1790772164.189113:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772164.189118:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.189125:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a9094f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772164.332125:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772164.332249:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412817280 00000100:00100000:1.0:1790772164.332263:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412817280 00000100:00100000:1.0:1790772164.332352:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 157 00000100:00100000:1.0:1790772164.332384:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+45:11429:x1877760412817280:12345-192.168.206.27@tcp:101:stat.0 00010000:00010000:1.0:1790772164.332421:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772164.332450:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90956 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c2d expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332540:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9095d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332603:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9095d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332629:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9095d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332649:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332657:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332664:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332795:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332805:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332811:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772164.332865:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1790772164.332870:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772164.332894:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332907:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332916:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9095d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332923:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9095d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332931:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9095d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332938:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772164.332943:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9095d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332952:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9095d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332965:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:1.0:1790772164.332968:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772164.332973:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9095d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.332980:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a9095d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.333005:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.333011:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90964 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.333017:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.333022:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772164.333025:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.333031:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.333037:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df27c001400) 00010000:00010000:1.0:1790772164.333039:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772164.333042:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90964 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.333047:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.333081:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c2d expref: 47 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.333094:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c2d expref: 46 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.333111:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:1.0:1790772164.333113:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772164.333115:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9c00, rc 0) 00000100:00100000:1.0:1790772164.333468:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+46:11429:x1877760412817280:12345-192.168.206.27@tcp:101:stat.0 Request processed in 1084us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772164.333476:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 157 00000100:00100000:3.0:1790772164.410536:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772164.410680:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412817536 00000100:00100000:0.0:1790772164.410693:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412817536 00000100:00100000:0.0:1790772164.410766:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 158 00000100:00100000:0.0:1790772164.410778:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+46:11439:x1877760412817536:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772164.410807:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772164.410844:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c34 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772164.410960:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790772164.411113:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90972 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c34 expref: 48 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.411129:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25a490700) 00010000:00010000:0.0:1790772164.411132:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772164.411155:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c34 expref: 48 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.411171:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031600, rc 0) 00000100:00100000:0.0:1790772164.411409:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+47:11439:x1877760412817536:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 632us (884us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1790772164.411417:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 158 00000100:00100000:3.0:1790772164.414530:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772164.414632:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412817792 00000100:00100000:0.0:1790772164.414645:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412817792 00000100:00100000:0.0:1790772164.414705:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:0.0:1790772164.414716:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25db8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+47:11439:x1877760412817792:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772164.415253:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25db8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+48:11439:x1877760412817792:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 537us (735us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1790772164.415262:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:3.0:1790772164.481638:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772164.481824:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412818048 00000100:00100000:0.0:1790772164.481849:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412818048 00000100:00100000:0.0:1790772164.481924:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 159 00000100:00100000:0.0:1790772164.481936:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+48:11445:x1877760412818048:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1790772164.481969:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772164.481995:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90980 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c3b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.482119:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.482138:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c2d expref: 49 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.482161:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.482202:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c2d expref: 49 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.482218:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c2d expref: 49 pid: 6701 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772164.482236:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428547584:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772164.482784:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df249225900 going to sleep for 11 seconds 00000100:00100000:0.0:1790772164.484489:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428547584:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772164.484737:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772164.486696:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772164.486888:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412818176 00000100:00100000:2.0:1790772164.486900:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412818176 00010000:00010000:2.0:1790772164.486957:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c2d expref: 50 pid: 6701 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772164.486997:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00100000:2.0:1790772164.487008:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+50:2348:x1877760412818176:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772164.487027:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772164.487035:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c2d expref: 50 pid: 6701 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.487050:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c2d expref: 50 pid: 6701 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.487075:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a9096b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c2d expref: 50 pid: 6701 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.487095:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:2.0:1790772164.487118:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.487130:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.487138:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.487184:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772164.487472:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+49:2348:x1877760412818176:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 464us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772164.487482:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 66 00010000:00010000:1.0:1790772164.487762:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.487772:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772164.487796:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1790772164.488006:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90980 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c3b expref: 50 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.488027:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c3b expref: 49 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.488035:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:1.0:1790772164.488039:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772164.488042:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031c00, rc 0) 00000100:00100000:1.0:1790772164.488079:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+49:11445:x1877760412818048:12345-192.168.206.27@tcp:101:bash.0 Request processed in 6145us (6468us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1790772164.488087:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 159 00000100:00100000:3.0:1790772164.491111:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772164.491330:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412818432 00000100:00100000:2.0:1790772164.491344:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412818432 00000100:00100000:2.0:1790772164.491420:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 160 00000100:00100000:2.0:1790772164.491432:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+49:11445:x1877760412818432:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:2.0:1790772164.492051:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.492074:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.492086:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772164.492313:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1790772164.492344:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e62ec230 reply state 00000000186ba884 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772164.492355:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772164.492540:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+52:11445:x1877760412818432:12345-192.168.206.27@tcp:36:bash.0 Request processed in 1108us (1441us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1790772164.492571:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 160 00000020:00080000:2.0:1790772164.492577:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790772164.495389:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.495431:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.495440:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.495448:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772164.495453:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.495463:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.495482:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:1.0:1790772164.495486:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772164.495491:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.495497:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90995 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772164.502191:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772164.502439:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412818560 00000100:00100000:1.0:1790772164.502452:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412818560 00000100:00100000:1.0:1790772164.502524:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 161 00000100:00100000:1.0:1790772164.502535:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+51:11445:x1877760412818560:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1790772164.502807:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772164.502836:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9099c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c42 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.503075:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.503110:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c3b expref: 52 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.503120:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.503162:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c3b expref: 52 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.503178:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c3b expref: 52 pid: 5824 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772164.503194:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428547712:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772164.503365:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927be40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772164.508775:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772164.509077:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df258e86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428547712:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772164.509116:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772164.509202:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412818688 00000100:00100000:0.0:1790772164.509211:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412818688 00010000:00010000:0.0:1790772164.509259:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c3b expref: 53 pid: 5824 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772164.509300:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:0.0:1790772164.509311:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:2347:x1877760412818688:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772164.509330:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772164.509337:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c3b expref: 53 pid: 5824 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.509369:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c3b expref: 53 pid: 5824 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.509395:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90987 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c3b expref: 53 pid: 5824 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.509415:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:0.0:1790772164.509420:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.509430:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.509438:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.509470:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772164.509539:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+52:2347:x1877760412818688:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 229us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772164.509546:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 67 00010000:00010000:1.0:1790772164.509708:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.509716:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772164.509784:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790772164.509789:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772164.509814:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.509864:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a9099c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c42 expref: 52 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.509881:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c42 expref: 51 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.509889:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:1.0:1790772164.509904:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772164.509907:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9800, rc 0) 00000100:00100000:1.0:1790772164.509939:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+51:11445:x1877760412818560:12345-192.168.206.27@tcp:101:bash.0 Request processed in 7406us (7762us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772164.509946:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 161 00000100:00100000:3.0:1790772164.513683:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772164.513787:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412818944 00000100:00100000:1.0:1790772164.513799:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412818944 00000100:00100000:1.0:1790772164.513854:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:1.0:1790772164.513865:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+51:11445:x1877760412818944:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:1.0:1790772164.514145:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+52:11445:x1877760412818944:12345-192.168.206.27@tcp:35:bash.0 Request processed in 281us (481us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1790772164.514154:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:3.0:1790772164.586528:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772164.586701:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412819200 00000100:00100000:0.0:1790772164.586715:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412819200 00000100:00100000:0.0:1790772164.586791:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 162 00000100:00100000:0.0:1790772164.586804:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+52:11455:x1877760412819200:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772164.586835:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772164.586862:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a909aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c49 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772164.587023:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790772164.587186:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a909aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c49 expref: 54 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.587205:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25a490700) 00010000:00010000:0.0:1790772164.587209:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790772164.587215:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a909aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c49 expref: 54 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.587232:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031c00, rc 0) 00000100:00100000:0.0:1790772164.587320:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:11455:x1877760412819200:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 519us (808us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1790772164.587327:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 162 00000100:00100000:3.0:1790772164.590036:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772164.590147:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412819328 00000100:00100000:0.0:1790772164.590160:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412819328 00000100:00100000:0.0:1790772164.590239:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 163 00000100:00100000:0.0:1790772164.590250:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:11455:x1877760412819328:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:0.0:1790772164.590354:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590373:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590385:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590400:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590423:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590430:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590530:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590539:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590545:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772164.590607:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590632:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590640:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590648:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590654:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772164.590658:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590666:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590699:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772164.590702:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772164.590707:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590714:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590729:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590736:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590742:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590747:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772164.590750:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590755:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590762:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df254043400) 00010000:00010000:0.0:1790772164.590764:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772164.590767:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590773:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590800:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590807:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590812:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590817:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772164.590820:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590827:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590835:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:0.0:1790772164.590838:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772164.590841:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.590847:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772164.591841:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:11455:x1877760412819328:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 1584us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772164.591855:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 163 00000100:00100000:3.0:1790772164.594209:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772164.594481:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412819584 00000100:00100000:1.0:1790772164.594493:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412819584 00000100:00100000:1.0:1790772164.594602:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:1.0:1790772164.594625:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:11455:x1877760412819584:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:1.0:1790772164.595060:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+54:11455:x1877760412819584:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 446us (868us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1790772164.595082:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:1.0:1790772164.628379:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772164.628541:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412819840 00000100:00100000:0.0:1790772164.628591:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412819840 00000100:00100000:0.0:1790772164.628731:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 164 00000100:00100000:0.0:1790772164.628763:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+54:11458:x1877760412819840:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772164.628796:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772164.628823:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c50 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.628934:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.628952:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.628965:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.628982:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.628990:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.628997:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629151:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a909e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629160:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a909e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629167:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a909e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772164.629190:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790772164.629401:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629410:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629416:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629423:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772164.629427:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629435:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629449:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772164.629452:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772164.629457:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629463:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a909d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629478:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629483:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629499:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629504:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772164.629506:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629512:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629520:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df254043400) 00010000:00010000:0.0:1790772164.629522:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772164.629525:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629530:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a909db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629647:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a909cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c50 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629666:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a909e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c50 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.629674:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:0.0:1790772164.629676:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772164.629679:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031c00, rc 0) 00000100:00100000:0.0:1790772164.629766:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:11458:x1877760412819840:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1006us (1401us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1790772164.629783:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 164 00000100:00100000:2.0:1790772164.634945:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772164.634999:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772164.635110:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412819968 00000100:00100000:3.0:1790772164.635123:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412819968 00000100:00100000:0.0:1790772164.635248:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412820096 00000100:00100000:0.0:1790772164.635253:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412820096 00000100:00100000:0.0:1790772164.635399:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:0.0:1790772164.635411:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:2347:x1877760412820096:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772164.635429:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772164.635458:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a909e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c50 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.635480:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:0.0:1790772164.635484:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772164.635577:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:2347:x1877760412820096:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 167us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772164.635585:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:3.0:1790772164.635819:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 165 00000100:00100000:3.0:1790772164.635828:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:11458:x1877760412819968:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:3.0:1790772164.635912:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a909f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.635932:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a909f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.635960:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a909f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.635991:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a909f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.635999:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a909f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.636006:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a909f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.636012:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772164.636017:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a909f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.636025:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a909f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.636035:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:3.0:1790772164.636038:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772164.636042:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a909f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.636048:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a909f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772164.636089:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:11458:x1877760412819968:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 263us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772164.636097:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 165 00000100:00100000:3.0:1790772164.638851:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772164.639014:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412820352 00000100:00100000:0.0:1790772164.639026:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412820352 00000100:00100000:0.0:1790772164.639131:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:0.0:1790772164.639151:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:11458:x1877760412820352:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772164.639502:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:11458:x1877760412820352:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 361us (664us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1790772164.639510:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00010000:00010000:3.0:1790772164.640478:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772164.788279:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772164.788641:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412820608 00000100:00100000:2.0:1790772164.788654:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412820608 00000100:00100000:2.0:1790772164.788742:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 166 00000100:00100000:2.0:1790772164.788753:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:11477:x1877760412820608:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:2.0:1790772164.788786:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772164.788812:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a909f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c57 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.788943:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a909fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.788961:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a909fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.788974:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a909fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772164.788987:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790772164.789141:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a909f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c57 expref: 59 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.789163:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a909fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c57 expref: 58 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772164.789189:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:2.0:1790772164.789193:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790772164.789197:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9abc00, rc 0) 00000100:00100000:2.0:1790772164.789278:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:11477:x1877760412820608:12345-192.168.206.27@tcp:101:cat.0 Request processed in 527us (1015us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1790772164.789287:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 166 00000100:00100000:2.0:1790772164.816007:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772164.816164:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412820736 00000100:00100000:3.0:1790772164.816178:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412820736 00000100:00100000:3.0:1790772164.816263:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 167 00000100:00100000:3.0:1790772164.816275:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:11478:x1877760412820736:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772164.816309:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772164.816336:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c5e expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.816423:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.816441:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.816455:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772164.816496:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790772164.816500:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772164.816521:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.816828:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c5e expref: 60 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.816852:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c5e expref: 59 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772164.816862:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:3.0:1790772164.816881:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772164.816886:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2400, rc 0) 00000100:00100000:2.0:1790772164.817432:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11478:x1877760412820736:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1154us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772164.817441:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 167 00000100:00100000:3.0:1790772164.822589:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772164.822830:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412821120 00000100:00100000:1.0:1790772164.822844:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412821120 00000100:00100000:1.0:1790772164.822926:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:1.0:1790772164.822938:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11478:x1877760412821120:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:1.0:1790772164.823362:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11478:x1877760412821120:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 424us (829us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1790772164.823372:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:1.0:1790772164.825939:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772164.826333:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412821248 00000100:00100000:0.0:1790772164.826346:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412821248 00000100:00100000:0.0:1790772164.826482:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:0.0:1790772164.826494:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11478:x1877760412821248:12345-192.168.206.27@tcp:103:lfs.0 00010000:00010000:0.0:1790772164.826536:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790772164.826626:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a909a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c42 expref: 60 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.826655:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a909fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c57 expref: 59 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.826667:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a908ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c03 expref: 58 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.826690:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001200) 00010000:00010000:0.0:1790772164.826703:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772164.826775:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:11478:x1877760412821248:12345-192.168.206.27@tcp:103:lfs.0 Request processed in 283us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772164.826784:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:3.0:1790772164.828719:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772164.828825:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412821376 00000100:00100000:1.0:1790772164.828835:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412821376 00000100:00100000:1.0:1790772164.828907:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 168 00000100:00100000:1.0:1790772164.828918:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:11478:x1877760412821376:12345-192.168.206.27@tcp:58:lfs.0 00010000:00010000:1.0:1790772164.829082:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90a1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.829103:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772164.829117:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772164.829374:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1790772164.829475:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:11478:x1877760412821376:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 557us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772164.829493:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 168 00000100:00100000:3.0:1790772164.851471:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772164.851680:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412821504 00000100:00100000:0.0:1790772164.851692:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412821504 00000100:00100000:0.0:1790772164.851768:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 169 00000100:00100000:0.0:1790772164.851779:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:11480:x1877760412821504:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772164.851809:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772164.851837:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90a21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c65 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.851939:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.851958:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.851995:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852014:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90a2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852022:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852029:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852145:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852155:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852162:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772164.852344:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790772164.852350:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772164.852376:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852390:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852400:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852426:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852432:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852439:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772164.852444:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852452:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852465:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772164.852468:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772164.852473:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852479:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852497:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852803:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90a2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852816:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852822:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772164.852832:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852840:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90a2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852850:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df254043400) 00010000:00010000:0.0:1790772164.852852:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772164.852856:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90a2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852863:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90a2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852967:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90a21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c65 expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852984:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c65 expref: 58 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772164.852992:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001400) 00010000:00010000:0.0:1790772164.852994:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772164.852997:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031200, rc 0) 00000100:00100000:0.0:1790772164.853133:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:11480:x1877760412821504:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1355us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772164.853143:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 169 00010000:00010000:2.0:1790772165.664025:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772165.664379:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772165.664386:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772165.664442:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1790772165.664452:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790772165.666751:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428547840:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790772165.669181:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27b3c2900 going to sleep for 11 seconds 00000100:00100000:0.0:1790772165.672360:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428547840:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790772165.672705:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772165.672930:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412821632 00000100:00100000:2.0:1790772165.672940:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412821632 00000100:00100000:2.0:1790772165.673021:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 170 00000100:00100000:2.0:1790772165.673032:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:11491:x1877760412821632:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790772165.673162:0:5825:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790772165.673288:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:11491:x1877760412821632:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 258us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772165.673297:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 170 00000100:00100000:3.0:1790772165.678143:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772165.693260:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412821760 00000100:00100000:2.0:1790772165.693281:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412821760 00000100:00100000:2.0:1790772165.693429:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 171 00000100:00100000:2.0:1790772165.693441:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:11491:x1877760412821760:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790772165.693540:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90a3d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693623:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90a3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693638:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90a3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693660:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693667:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693673:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693708:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693718:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693724:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772165.693770:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790772165.693775:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772165.693791:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693804:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90a3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693821:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90a3d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.693829:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90a3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695583:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772165.695591:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90a3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695603:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90a3d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695635:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:2.0:1790772165.695639:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772165.695646:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90a3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695653:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90a3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695670:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695678:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a44 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695685:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695691:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aac00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772165.695706:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695712:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a44 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695721:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8df25a490d00) 00010000:00010000:2.0:1790772165.695724:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772165.695728:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a44 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695734:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695763:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695769:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695775:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695781:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772165.695784:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695789:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695797:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001400) 00010000:00010000:2.0:1790772165.695799:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772165.695810:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.695817:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772165.696019:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:11491:x1877760412821760:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 Request processed in 2573us (17883us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772165.696030:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 171 00000100:00100000:3.0:1790772165.708057:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772165.708135:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412822016 00000100:00100000:2.0:1790772165.708147:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412822016 00000100:00100000:2.0:1790772165.708220:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 172 00000100:00100000:2.0:1790772165.708233:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:11491:x1877760412822016:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772165.708263:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772165.708291:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c6c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708419:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708439:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708452:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772165.708465:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790772165.708636:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708645:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708661:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708668:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aac00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772165.708674:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708684:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708700:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001400) 00010000:00010000:2.0:1790772165.708704:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772165.708711:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708718:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708768:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a52 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c6c expref: 60 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708779:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:2.0:1790772165.708781:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772165.708786:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90a52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c6c expref: 60 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.708796:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9abc00, rc 0) 00000100:00100000:2.0:1790772165.708882:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11491:x1877760412822016:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 651us (839us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1790772165.708898:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 172 00000040:00080000:0.0:1790772165.712140:0:12382:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772165.712152:0:12382:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772165.712195:0:12382:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1790772165.712202:0:12382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790772165.716450:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772165.716535:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412822144 00000100:00100000:3.0:1790772165.716573:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412822144 00000100:00100000:3.0:1790772165.716644:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 173 00000100:00100000:3.0:1790772165.716656:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11491:x1877760412822144:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790772165.716701:0:5824:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790772165.717667:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11491:x1877760412822144:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 1008us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772165.717678:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 173 00000100:00100000:3.0:1790772165.721810:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772165.722118:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412822400 00000100:00100000:0.0:1790772165.722132:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412822400 00000100:00100000:0.0:1790772165.722204:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 174 00000100:00100000:0.0:1790772165.722215:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11491:x1877760412822400:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772165.722242:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772165.722246:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790772165.722280:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c5e expref: 59 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.722302:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772165.722307:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772165.722323:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90a67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c73 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772165.726861:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1790772165.727113:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.727136:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.727176:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.727262:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90a67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c73 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.727283:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c73 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.727293:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df254043400) 00010000:00010000:0.0:1790772165.727297:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772165.727300:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030c00, rc 0) 00000100:00100000:0.0:1790772165.727402:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11491:x1877760412822400:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 5187us (5603us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1790772165.727412:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 174 00000100:00100000:3.0:1790772165.735266:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772165.735387:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412822656 00000100:00100000:0.0:1790772165.735401:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412822656 00000100:00100000:0.0:1790772165.735475:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 175 00000100:00100000:0.0:1790772165.735487:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11491:x1877760412822656:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772165.735582:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772165.735626:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90a6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c73 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735651:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df254043400) 00010000:00010000:0.0:1790772165.735665:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772165.735695:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90a7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735727:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90a7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735738:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90a7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735755:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfdf5d86a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735763:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdf5d86a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735769:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdf5d86a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735847:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90a7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735855:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90a7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735862:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90a7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735868:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772165.735873:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90a7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735881:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90a7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735900:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772165.735909:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772165.735916:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90a7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735922:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90a7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735933:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdf5d86a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735939:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdf5d86a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735946:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdf5d86a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735951:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772165.735954:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdf5d86a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735960:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfdf5d86a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735968:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfdf5d86a (ffff8df254043700) 00010000:00010000:0.0:1790772165.735971:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772165.735974:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfdf5d86a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.735979:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90a83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfdf5d86a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772165.736078:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11491:x1877760412822656:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 593us (827us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772165.736092:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 175 00000100:00100000:2.0:1790772165.742096:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772165.742244:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412822784 00000100:00100000:3.0:1790772165.742259:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412822784 00000100:00100000:3.0:1790772165.742334:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 176 00000100:00100000:3.0:1790772165.742347:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11491:x1877760412822784:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772165.742375:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772165.742402:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c7a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.742447:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.742485:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.742498:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.742689:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c7a expref: 61 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.742711:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c7a expref: 60 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.742720:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df247e07900) 00010000:00010000:3.0:1790772165.742723:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790772165.742727:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2e00, rc 0) 00000100:00100000:3.0:1790772165.742813:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11491:x1877760412822784:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 468us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772165.742820:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 176 00000100:00100000:0.0:1790772165.758245:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772165.758320:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412823040 00000100:00100000:1.0:1790772165.758329:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412823040 00000100:00100000:1.0:1790772165.758385:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 177 00000100:00100000:1.0:1790772165.758394:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11491:x1877760412823040:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790772165.758854:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.758871:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.758883:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772165.759128:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1790772165.759137:0:6701:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331903587140ns, next at 332903585413ns, rc = 0 00000004:00010000:1.0:1790772165.759574:0:6701:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bbb33331 reply state 0000000064d6cbb9 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772165.759585:0:6701:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772165.759939:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+62:11491:x1877760412823040:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1544us (1794us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1790772165.759948:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 177 00010000:00010000:3.0:1790772165.766871:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.766890:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.766898:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.766904:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772165.766909:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.766927:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.766944:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df247e07900) 00010000:00010000:3.0:1790772165.766946:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790772165.767138:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.767146:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90a98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772165.767325:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772165.767358:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412823168 00000100:00100000:3.0:1790772165.767367:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412823168 00000100:00100000:3.0:1790772165.767415:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 178 00000100:00100000:3.0:1790772165.767424:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11491:x1877760412823168:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772165.767447:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772165.767462:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c81 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.767521:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c81 expref: 62 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.767534:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c81 expref: 62 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.767573:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df247e07900) 00010000:00010000:3.0:1790772165.767576:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790772165.767585:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3c00, rc 0) 00000100:00100000:3.0:1790772165.767652:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+62:11491:x1877760412823168:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 228us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772165.767659:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 178 00000100:00100000:2.0:1790772165.777042:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772165.777234:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412823296 00000100:00100000:1.0:1790772165.777244:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412823296 00000100:00100000:1.0:1790772165.777326:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:1.0:1790772165.777337:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2347:x1877760412823296:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790772165.777339:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772165.777811:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412823296:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 475us (778us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790772165.777819:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:3.0:1790772165.781659:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772165.781872:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412823552 00000100:00100000:2.0:1790772165.781882:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412823552 00000100:00100000:2.0:1790772165.781938:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:2.0:1790772165.781948:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+62:11491:x1877760412823552:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790772165.782186:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+63:11491:x1877760412823552:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 239us (534us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1790772165.782195:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:3.0:1790772165.783985:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772165.784069:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412823808 00000100:00100000:1.0:1790772165.784076:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412823808 00000100:00100000:1.0:1790772165.785275:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 179 00000100:00100000:1.0:1790772165.785290:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+63:11491:x1877760412823808:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790772165.785382:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+63:11491:x1877760412823808:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 99us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772165.785390:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 179 00000100:00100000:3.0:1790772165.788845:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772165.788926:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412823936 00000100:00100000:2.0:1790772165.788936:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412823936 00000100:00100000:2.0:1790772165.788995:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 180 00000100:00100000:2.0:1790772165.789004:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+63:11491:x1877760412823936:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772165.789025:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772165.789044:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90aa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c88 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.789115:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90aad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.789135:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.789154:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772165.789203:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772165.789221:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.789248:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c88 expref: 65 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.789264:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c88 expref: 64 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.789273:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df247e07900) 00010000:00010000:2.0:1790772165.789276:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790772165.789279:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab600, rc 0) 00000100:00100000:2.0:1790772165.789336:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+64:11491:x1877760412823936:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 333us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772165.789344:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 180 00000100:00100000:2.0:1790772165.792070:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772165.795907:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412824064 00000100:00100000:3.0:1790772165.795921:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412824064 00000100:00100000:2.0:1790772165.796033:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:2.0:1790772165.796043:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412824064:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772165.796060:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772165.796078:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90ab4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c8f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772165.796104:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd03c5, blocks: 0x1 00010000:00010000:2.0:1790772165.796122:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1790772165.796126:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772165.796244:0:6678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c8f expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.796268:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c8f expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.796282:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aac00, rc 0) 00000100:00100000:2.0:1790772165.796381:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412824064:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 339us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772165.796389:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:2.0:1790772165.805219:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772165.805307:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412824320 00000100:00100000:1.0:1790772165.805317:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412824320 00000100:00100000:1.0:1790772165.805372:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 181 00000100:00100000:1.0:1790772165.805381:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+64:11491:x1877760412824320:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790772165.805529:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+64:11491:x1877760412824320:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 148us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772165.805537:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 181 00000100:00100000:3.0:1790772165.814214:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772165.814467:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412824448 00000100:00100000:1.0:1790772165.814477:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412824448 00000100:00100000:1.0:1790772165.814534:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:1.0:1790772165.814544:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:11491:x1877760412824448:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772165.814632:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772165.814649:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c96 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.814709:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90ab4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c8f expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.814719:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772165.814724:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772165.814730:0:6679:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.814764:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c8f expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.814778:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90ab4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c8f expref: 9 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772165.814792:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1877760428547968:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772165.814870:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927be40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772165.817589:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1877760428547968:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772165.817642:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.817732:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9c00, rc 0) 00000100:00100000:1.0:1790772165.817794:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:11491:x1877760412824448:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 3251us (3589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772165.817804:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:3.0:1790772165.823180:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772165.823306:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412824576 00000100:00100000:1.0:1790772165.823315:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412824576 00010000:00010000:1.0:1790772165.823351:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90ab4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c8f expref: 9 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772165.823394:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:1.0:1790772165.823402:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2348:x1877760412824576:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772165.823416:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772165.823435:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90ab4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c8f expref: 9 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.823449:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c8f expref: 9 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.823472:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90ab4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c8f expref: 9 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.823487:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772165.823491:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772165.823499:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.823509:0:5809:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.823544:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772165.823602:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5809:1877760428548096:192.168.206.27@tcp:105: 00000100:00100000:1.0:1790772165.823687:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927be40 going to sleep for 11 seconds 00000100:00100000:1.0:1790772165.827183:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772165.827299:0:6684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412824704 00000100:00100000:3.0:1790772165.827308:0:6684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412824704 00002000:00100000:3.0:1790772165.827352:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8df2746e5f80 x1877760412824704/t0(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:511/0 lens 504/0 e 0 to 0 dl 1790772176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790772165.827363:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2746e5f80 with x1877760412824704 ext(0->8) 00002000:00010000:3.0:1790772165.827369:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2746e5f80 00000100:00100000:3.0:1790772165.827403:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:3.0:1790772165.827412:0:6684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2347:x1877760412824704:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790772165.827857:0:6684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:2347:x1877760412824704:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 Request processed in 444us (679us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1790772165.827865:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00002000:00100000:3.0:1790772165.827873:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8df2746e5f80 x1877760412824704/t4294967314(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:511/0 lens 504/448 e 0 to 0 dl 1790772176 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790772165.827881:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2746e5f80 with x1877760412824704 ext(0->8) 00002000:00010000:3.0:1790772165.827891:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2746e5f80 00000100:00100000:3.0:1790772165.831870:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772165.831870:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5809:1877760428548096:192.168.206.27@tcp:105: 00010000:00010000:1.0:1790772165.831893:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772165.831943:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:2348:x1877760412824576:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 8541us (8771us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772165.831954:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:2.0:1790772165.832129:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412824832 00000100:00100000:2.0:1790772165.832136:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412824832 00000100:00100000:2.0:1790772165.832188:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 182 00000100:00100000:2.0:1790772165.832198:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+64:11491:x1877760412824832:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790772165.909422:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:1.0:1790772165.909471:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1790772165.909475:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1790772165.909517:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1790772165.909535:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1790772165.909579:0:5845:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df27fcfab40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1790772165.909585:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df259114700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df27fcfaa80 00000020:00080000:1.0:1790772165.909588:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df259114200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df24630cc00 00000020:00080000:1.0:1790772165.909726:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1790772165.909900:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1790772165.910256:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428548352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790772165.910326:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772165.910441:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428548352 00000100:00100000:3.0:1790772165.910450:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428548352 00000100:00100000:3.0:1790772165.910510:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790772165.910519:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428548352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1790772165.910699:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790772165.910702:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790772165 00002000:00010000:3.0:1790772165.910705:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790772165.910707:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790772165 -> 1790772165 00002000:00010000:3.0:1790772165.910709:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790772165.910750:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1877760428548352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (424us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790772165.910758:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790772165.910980:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:11491:x1877760412824832:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 Request processed in 78781us (79113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772165.910989:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 182 00000100:00100000:2.0:1790772165.911016:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428548224:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790772165.911169:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772165.911213:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428548224 00000100:00100000:2.0:1790772165.911218:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428548224 00000100:00100000:2.0:1790772165.911246:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790772165.911253:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3294:x1877760428548224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790772165.911268:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1790772165.911294:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abd03c2, atime: 0x6abd03c2, ctime: 0x6abd03c2, blocks: 0x1 00010000:00010000:2.0:1790772165.911315:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ac2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.911331:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1790772165.911336:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772165.911342:0:6678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.911358:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.911369:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.911378:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.911397:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1790772165.911985:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772165.911990:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1790772165.912036:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df27ae0c000/2, rc 0, transno 4294967315 00000100:00100000:1.0:1790772165.912043:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428548352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790772165.912221:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1877760428548224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 968us (1050us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790772165.912228:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1790772165.912257:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772165.912263:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.912274:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772165.912278:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.912294:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ac2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.912311:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ac2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.912318:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ac2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.912335:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772165.912337:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772165.912338:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790772165.913876:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df2746e4700/2, rc 0, transno 4294967307 00000100:00100000:1.0:1790772165.913991:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428548224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790772165.915012:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772165.915163:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412824960 00000100:00100000:1.0:1790772165.915171:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412824960 00000100:00100000:1.0:1790772165.915224:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:1.0:1790772165.915234:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:2348:x1877760412824960:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1790772165.967138:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1790772165.967158:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1790772165.967162:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1790772165.967316:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412824960:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 Request processed in 52077us (52302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772165.967327:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:3.0:1790772165.970448:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772165.970599:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412825216 00000100:00100000:1.0:1790772165.970628:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412825216 00000100:00100000:1.0:1790772165.970700:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 183 00000100:00100000:1.0:1790772165.970711:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:11491:x1877760412825216:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790772165.970762:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772165.970791:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c88 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.970812:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df247e07900) 00010000:00010000:1.0:1790772165.970817:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772165.970848:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.970862:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.970870:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772165.971116:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002de9d107 reply state 00000000d13e2f7e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772165.971125:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790772165.971228:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:11491:x1877760412825216:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 519us (794us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1790772165.971236:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 183 00010000:00010000:1.0:1790772165.977215:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.977232:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.977240:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.977247:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772165.977252:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.977259:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.977275:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df247e07900) 00010000:00010000:1.0:1790772165.977278:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772165.977282:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772165.977288:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ac9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772165.978202:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772165.980584:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412825344 00000100:00100000:2.0:1790772165.980615:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412825344 00000100:00100000:2.0:1790772165.980679:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:2.0:1790772165.980690:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412825344:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790772165.980928:0:8509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790772165.980931:0:8509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790772165 -> 1790772163 00002000:00010000:2.0:1790772165.980934:0:8509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790772162 00002000:00010000:2.0:1790772165.980936:0:8509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790772165 -> 1790772163 00002000:00010000:2.0:1790772165.980938:0:8509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790772165.981013:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412825344:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 325us (2829us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790772165.981021:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:3.0:1790772165.991096:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772165.993985:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412825600 00000100:00100000:0.0:1790772165.994005:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412825600 00000100:00100000:0.0:1790772165.994104:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 184 00000100:00100000:0.0:1790772165.994117:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:11491:x1877760412825600:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790772165.994212:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.994234:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c7a expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.994246:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.994294:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c7a expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772165.994310:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c7a expref: 19 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772165.994327:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27fcab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428548480:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772165.994462:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acc300 going to sleep for 11 seconds 00000100:00100000:0.0:1790772165.997749:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772165.997884:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412825728 00000100:00100000:2.0:1790772165.997903:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412825728 00010000:00010000:2.0:1790772165.997957:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c7a expref: 20 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772165.998009:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:2.0:1790772165.998020:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246097450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:2347:x1877760412825728:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772165.998038:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772165.998045:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c7a expref: 20 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.998060:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c7a expref: 20 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.998087:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df247e07900) 00010000:00010000:2.0:1790772165.998093:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.998104:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.998114:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772165.998135:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772165.998210:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246097450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:2347:x1877760412825728:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 190us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772165.998218:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00010000:00010000:3.0:1790772165.998531:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90a91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c7a expref: 19 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772165.998591:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27fcab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428548480:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772165.998625:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.998636:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.998655:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.998689:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.998698:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.998705:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.998712:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772165.998717:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.998725:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.998736:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df247e07900) 00010000:00010000:3.0:1790772165.998739:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790772165.998743:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772165.998750:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90ad0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772166.010147:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+18:11491:x1877760412825600:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 Request processed in 16015us (19047us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790772166.010186:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 184 00000100:00100000:0.0:1790772166.014764:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772166.015604:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412825856 00000100:00100000:2.0:1790772166.015628:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412825856 00000100:00100000:2.0:1790772166.015756:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:2.0:1790772166.015769:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412825856:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790772166.015845:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.015874:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.015885:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790772166.015891:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772166.015896:0:6678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.015942:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.015960:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 8 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772166.015977:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1877760428548608:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772166.016086:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247cc1840 going to sleep for 11 seconds 00000100:00100000:2.0:1790772166.019898:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1877760428548608:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772166.019957:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772166.021739:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772166.021951:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412825984 00000100:00100000:2.0:1790772166.021964:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412825984 00010000:00010000:2.0:1790772166.022014:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 9 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772166.022055:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:2.0:1790772166.022066:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2348:x1877760412825984:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772166.022086:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772166.022116:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 9 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.022131:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 9 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.022161:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3dbd64b/0xdf68d9a7d6a90abb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c96 expref: 9 pid: 6679 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.022181:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772166.022186:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772166.022193:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.022204:0:5810:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.022262:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772166.022341:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412825984:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 275us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772166.022348:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 70 00010000:00010000:3.0:1790772166.023094:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772166.023108:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772166.023155:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772166.023164:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772166.023173:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772166.023181:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772166.023186:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772166.023195:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772166.023211:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772166.023219:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056d8b31b/0xdf68d9a7d6a90ad7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772166.023312:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412825856:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 Request processed in 7544us (8563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772166.023322:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:0.0:1790772166.030316:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772166.033401:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412826240 00000100:00100000:1.0:1790772166.033427:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412826240 00000100:00100000:1.0:1790772166.033584:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 185 00000100:00100000:1.0:1790772166.033596:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+18:11491:x1877760412826240:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790772166.033725:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90ade lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.033748:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90ade lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790772166.033758:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790772166.033763:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90ade lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.034110:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.034125:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c81 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.034134:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.034178:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c81 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.034197:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c81 expref: 19 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772166.034213:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428548736:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772166.034355:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772166.046126:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772166.046276:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412826368 00000100:00100000:2.0:1790772166.046288:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412826368 00010000:00010000:2.0:1790772166.046339:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a9f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c81 expref: 20 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772166.046387:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 71 00000100:00100000:2.0:1790772166.046398:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:2348:x1877760412826368:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772166.046417:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772166.046424:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a9f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c81 expref: 20 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.046439:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c81 expref: 20 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.046475:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df247e07900) 00010000:00010000:2.0:1790772166.046481:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.046492:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.046501:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.046532:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772166.046657:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:2348:x1877760412826368:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 260us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772166.046666:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 71 00010000:00010000:1.0:1790772166.047017:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90a9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c81 expref: 19 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772166.047039:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428548736:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772166.047068:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.047079:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.047085:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772166.047285:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1790772166.047432:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1790772166.047616:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1790772166.047727:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5824:1877760428548864:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790772166.047799:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772166.047903:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927b540 going to sleep for 11 seconds 00000100:00100000:0.0:1790772166.053375:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428548864 00000100:00100000:0.0:1790772166.053397:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428548864 00000100:00100000:0.0:1790772166.053543:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790772166.053581:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1877760428548864:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790772166.053768:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1877760428548864:12345-0@lo:1000:mdt00_001.0 Request processed in 191us (5969us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772166.053777:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772166.053904:0:5824:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1790772166.053912:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df27ae0c000, transno 4294967315 00000100:00100000:2.0:1790772166.053926:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5824:1877760428548864:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790772166.054601:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1790772166.054723:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5824:1877760428548992:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790772166.054779:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772166.063279:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25913ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772166.066534:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428548992 00000100:00100000:1.0:1790772166.066821:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428548992 00000100:00100000:1.0:1790772166.066914:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772166.066929:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1877760428548992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790772166.067412:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1877760428548992:12345-0@lo:1000:mdt00_001.0 Request processed in 485us (12630us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1790772166.067422:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772166.070861:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5824:1877760428548992:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790772166.070930:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.070944:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.070952:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.070959:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772166.070964:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.070974:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071021:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df247e07900) 00010000:00010000:2.0:1790772166.071024:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772166.071030:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071036:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90ae5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071075:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071082:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90a1a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071088:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90a1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071093:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772166.071096:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90a1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071102:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90a1a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071110:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001400) 00010000:00010000:2.0:1790772166.071113:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772166.071116:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90a1a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071123:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a90a1a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071161:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071178:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c65 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071188:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071235:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c65 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.071253:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c65 expref: 22 pid: 5824 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772166.071268:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273ee6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428549120:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772166.071373:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25913ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772166.077314:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273ee6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428549120:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772166.077355:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772166.078438:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772166.078508:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412826496 00000100:00100000:2.0:1790772166.078518:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412826496 00010000:00010000:2.0:1790772166.078612:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c65 expref: 23 pid: 5824 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772166.079200:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 72 00000100:00100000:1.0:1790772166.079437:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:2347:x1877760412826496:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772166.079481:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772166.079492:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c65 expref: 23 pid: 5824 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.079509:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c65 expref: 23 pid: 5824 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.079539:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90a36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c65 expref: 23 pid: 5824 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.080828:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001400) 00010000:00010000:1.0:1790772166.080842:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.080858:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.080867:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772166.083723:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772166.083837:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:2347:x1877760412826496:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 4402us (5395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772166.083852:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 72 00010000:00010000:2.0:1790772166.084404:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.084440:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.084957:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.084968:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.084978:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.084985:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aba00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772166.084991:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.085201:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.085417:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001400) 00010000:00010000:2.0:1790772166.085420:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772166.085426:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.085433:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90aec lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.085453:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90ade lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.085460:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90ade lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.085484:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90ade lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.085488:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772166.085491:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90ade lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.085497:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90ade lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.085504:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001400) 00010000:00010000:2.0:1790772166.085506:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790772166.085509:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90ade lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.085514:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90ade lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772166.086505:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:11491:x1877760412826240:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 52888us (56181us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1790772166.086522:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 185 00000020:00080000:3.0:1790772166.086530:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1790772166.096524:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000040:00080000:1.0:1790772166.099318:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790772166.099334:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772166.101373:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790772166.101400:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790772166.106421:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412826752 00000100:00100000:2.0:1790772166.106445:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412826752 00000100:00100000:2.0:1790772166.106645:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:2.0:1790772166.106658:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25db8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:11491:x1877760412826752:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790772166.107469:0:5827:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790772166.107640:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1790772166.107694:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.107714:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.107741:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.107751:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.107758:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.107765:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772166.107784:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772166.107877:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772166.107887:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.107895:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772166.107900:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.107917:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772166.107929:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25db8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:11491:x1877760412826752:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 1267us (11414us total) trans 4294967468 rc 0/0 00010000:00010000:1.0:1790772166.107934:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df251c57300) 00010000:00010000:1.0:1790772166.107939:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1790772166.107942:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 50 00010000:00010000:1.0:1790772166.107947:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790772166.107950:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790772166.107958:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90af3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772166.107984:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772166.107987:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772166.107990:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772166.689574:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790772167.187655:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1790772167.187677:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1790772167.187688:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000040:00080000:2.0:1790772167.707079:0:12435:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772167.707093:0:12435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772167.707151:0:12435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1790772167.707158:0:12435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790772167.712791:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772167.873412:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772167.873503:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412827008 00000100:00100000:3.0:1790772167.873515:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412827008 00000100:00100000:3.0:1790772167.873614:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 186 00000100:00100000:3.0:1790772167.873626:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:11509:x1877760412827008:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772167.873665:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772167.873691:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226c9d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.873808:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90b01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.873825:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90b01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.873839:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90b01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772167.873852:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790772167.874012:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c9d expref: 26 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.874031:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90b01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c9d expref: 25 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.874053:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:3.0:1790772167.874055:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790772167.874059:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a2e00, rc 0) 00000100:00100000:3.0:1790772167.874130:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:11509:x1877760412827008:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 507us (732us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1790772167.874137:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 186 00000100:00100000:3.0:1790772167.876994:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772167.882725:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412827136 00000100:00100000:1.0:1790772167.882743:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412827136 00000100:00100000:1.0:1790772167.883527:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 187 00000100:00100000:1.0:1790772167.883544:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:11509:x1877760412827136:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:1.0:1790772167.883688:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90b0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.883709:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90b0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.883721:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90b0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.883750:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.883758:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.883765:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884070:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884080:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884088:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790772167.884135:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884150:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90b0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884158:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90b0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884165:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90b0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884172:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772167.884177:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90b0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884193:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90b0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884207:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:1.0:1790772167.884211:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772167.884216:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90b0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884223:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90b0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884236:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884242:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90b16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884248:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884254:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772167.884257:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884263:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90b16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884269:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df27c001200) 00010000:00010000:1.0:1790772167.884272:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772167.884274:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90b16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884290:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90b16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884307:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884313:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884318:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884323:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772167.884327:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884333:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884341:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df27c001c00) 00010000:00010000:1.0:1790772167.884343:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772167.884347:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772167.884353:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772167.884461:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:11509:x1877760412827136:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 920us (7584us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772167.884471:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 187 00000100:00100000:1.0:1790772167.955870:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772167.956250:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412827392 00000100:00100000:3.0:1790772167.956262:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412827392 00000100:00100000:3.0:1790772167.956374:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 188 00000100:00100000:3.0:1790772167.956386:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+25:11512:x1877760412827392:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772167.956415:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772167.956442:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90b24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ca4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.956534:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90b2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.956613:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.956627:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.956644:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a90b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.956652:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a90b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.956681:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a90b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957023:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957033:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957040:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772167.957052:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790772167.957160:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957170:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90b2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957177:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957183:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772167.957189:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957198:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90b2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957213:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:3.0:1790772167.957217:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772167.957230:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90b2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957237:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3400/0xdf68d9a7d6a90b2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957253:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a90b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957260:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a90b32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957266:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a90b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957272:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772167.957275:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a90b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957281:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a90b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957289:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df247e07d00) 00010000:00010000:3.0:1790772167.957292:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772167.957294:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a90b32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957299:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3200/0xdf68d9a7d6a90b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957351:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2400/0xdf68d9a7d6a90b24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ca4 expref: 28 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957381:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ca4 expref: 27 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772167.957388:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:3.0:1790772167.957391:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772167.957393:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2414a3c00, rc 0) 00000100:00100000:3.0:1790772167.957478:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:11512:x1877760412827392:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1095us (1623us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1790772167.957487:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 188 00000100:00100000:1.0:1790772167.966865:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772167.967963:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412827520 00000100:00100000:2.0:1790772167.967977:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412827520 00000100:00100000:2.0:1790772167.968050:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 189 00000100:00100000:2.0:1790772167.968061:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:11512:x1877760412827520:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:2.0:1790772167.968148:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772167.968181:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772167.968195:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772167.968227:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772167.968234:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772167.968242:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772167.968249:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aac00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772167.968254:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772167.968262:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772167.968275:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:2.0:1790772167.968278:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772167.968284:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772167.968290:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772167.968390:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:11512:x1877760412827520:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 330us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772167.968405:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 189 00000100:00100000:1.0:1790772167.971368:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772167.971454:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412827776 00000100:00100000:2.0:1790772167.971466:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412827776 00000100:00100000:2.0:1790772167.971532:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:2.0:1790772167.971542:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:11512:x1877760412827776:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1790772167.973005:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:11512:x1877760412827776:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 1453us (1639us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1790772167.973018:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:3.0:1790772168.027108:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.027370:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412828032 00000100:00100000:2.0:1790772168.027384:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412828032 00000100:00080000:3.0:1790772168.027536:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790772168.027537:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 190 00000100:00100000:2.0:1790772168.027592:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:11039:x1877760412828032:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1790772168.027637:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772168.027674:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cab expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.027810:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.027828:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ca4 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.027838:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.027891:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ca4 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.027934:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ca4 expref: 29 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772168.027954:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273ee7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428549248:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772168.028067:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b82c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772168.030639:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273ee7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428549248:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772168.030685:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772168.032840:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.032995:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412828160 00000100:00100000:2.0:1790772168.033006:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412828160 00010000:00010000:2.0:1790772168.033063:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ca4 expref: 30 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772168.033116:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00100000:2.0:1790772168.033127:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:2348:x1877760412828160:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772168.033151:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772168.033159:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ca4 expref: 30 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.033174:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ca4 expref: 30 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.033201:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a3c00/0xdf68d9a7d6a90b39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ca4 expref: 30 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.033320:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:2.0:1790772168.033326:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.033337:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.033351:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.033393:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772168.033464:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:2348:x1877760412828160:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 337us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.033472:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 73 00010000:00010000:3.0:1790772168.034390:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.034404:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772168.034431:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790772168.034685:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aac00/0xdf68d9a7d6a90b4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cab expref: 30 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.034707:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cab expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.034715:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:3.0:1790772168.034719:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790772168.034734:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9abc00, rc 0) 00000100:00100000:3.0:1790772168.034800:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:11039:x1877760412828032:12345-192.168.206.27@tcp:101:bash.0 Request processed in 7253us (7706us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1790772168.034808:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 190 00000100:00100000:3.0:1790772168.038696:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.040426:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412828416 00000100:00100000:2.0:1790772168.040446:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412828416 00000100:00100000:2.0:1790772168.040533:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 191 00000100:00100000:2.0:1790772168.040544:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:11039:x1877760412828416:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:2.0:1790772168.041499:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.041522:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.041535:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772168.042501:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1790772168.042730:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002927c266 reply state 0000000065df8ff3 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772168.042761:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1790772168.042849:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1790772168.043216:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:11039:x1877760412828416:12345-192.168.206.27@tcp:36:bash.0 Request processed in 2666us (4528us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1790772168.043226:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 191 00000020:00080000:2.0:1790772168.043242:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1790772168.046927:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772168.047015:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412828544 00000100:00100000:0.0:1790772168.047029:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412828544 00000100:00100000:0.0:1790772168.047098:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 192 00000100:00100000:0.0:1790772168.047110:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:11039:x1877760412828544:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1790772168.047146:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772168.047173:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90b6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cb2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.047265:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90b6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb2 expref: 34 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.047283:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90b6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb2 expref: 34 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.047327:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:0.0:1790772168.047331:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772168.047335:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030e00, rc 0) 00000100:00100000:0.0:1790772168.047409:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+34:11039:x1877760412828544:12345-192.168.206.27@tcp:101:bash.0 Request processed in 301us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772168.047417:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 192 00010000:00010000:3.0:1790772168.049032:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.049052:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.049061:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.049067:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aae00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772168.049073:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.049082:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.049102:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:3.0:1790772168.049105:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772168.049110:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.049117:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90b63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772168.051102:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.051219:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412828672 00000100:00100000:2.0:1790772168.051241:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412828672 00000100:00100000:2.0:1790772168.051331:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:2.0:1790772168.051344:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:11039:x1877760412828672:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1790772168.051371:0:8509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772168.051401:0:8509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90b71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cb9 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790772168.051432:0:8509:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abd03c3, atime: 0x6abd03c2, ctime: 0x6abd03c3, blocks: 0xb 00010000:00010000:2.0:1790772168.051459:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=334s v=(0 0) 00010000:00010000:2.0:1790772168.051465:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772168.051474:0:8509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90b71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb9 expref: 8 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.051494:0:8509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90b71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb9 expref: 8 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.051507:0:8509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aac00, rc 0) 00000100:00100000:2.0:1790772168.051627:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:11039:x1877760412828672:12345-192.168.206.27@tcp:101:bash.0 Request processed in 285us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.051666:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00080000:3.0:1790772168.051883:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772168.054707:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.054904:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412828800 00000100:00100000:2.0:1790772168.054917:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412828800 00002000:00010000:2.0:1790772168.054967:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1790772168.054973:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2746e7100 with x1877760412828800 ext(0->18446744073709551615) 00002000:00010000:2.0:1790772168.054988:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2746e7100. 00000100:00100000:2.0:1790772168.055023:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1790772168.055033:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2347:x1877760412828800:12345-192.168.206.27@tcp:10:bash.0 00002000:00010000:2.0:1790772168.055484:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790772168.055489:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790772163 -> 1790772167 00002000:00010000:2.0:1790772168.055491:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1790772162 -> 1790772162 00002000:00010000:2.0:1790772168.055494:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790772163 -> 1790772167 00002000:00010000:2.0:1790772168.055496:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790772168.055650:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2347:x1877760412828800:12345-192.168.206.27@tcp:10:bash.0 Request processed in 616us (953us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790772168.055717:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00002000:00010000:2.0:1790772168.055722:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1790772168.055725:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2746e7100 with x1877760412828800 ext(0->18446744073709551615) 00002000:00010000:2.0:1790772168.055731:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2746e7100. 00000100:00100000:1.0:1790772168.156303:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.156484:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412828928 00000100:00100000:2.0:1790772168.156496:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412828928 00000100:00100000:2.0:1790772168.156607:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 193 00000100:00100000:2.0:1790772168.156620:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:11526:x1877760412828928:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:2.0:1790772168.156728:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.156771:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.156784:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.156803:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.156810:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.156818:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157364:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157378:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157387:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772168.157435:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157449:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157455:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157472:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157479:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772168.157484:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157493:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157507:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:2.0:1790772168.157510:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772168.157515:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157522:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157536:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.157543:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158314:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158322:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772168.158326:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158349:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158363:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df25a490e00) 00010000:00010000:2.0:1790772168.158365:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772168.158369:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158376:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158399:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158407:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158413:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158418:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abe00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772168.158420:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158426:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158434:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:2.0:1790772168.158436:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772168.158439:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.158457:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772168.158635:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:11526:x1877760412828928:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 2005us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.158646:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 193 00000100:00100000:1.0:1790772168.159901:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428549376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772168.159973:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772168.160151:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428549376 00000100:00100000:3.0:1790772168.160160:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428549376 00000100:00100000:3.0:1790772168.160258:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790772168.160268:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428549376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772168.160314:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772168.160367:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428549376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772168.160375:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790772168.160420:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1790772168.160427:0:3296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1790772168.160448:0:3296:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df2746e4700, transno 4294967307 00000100:00100000:3.0:1790772168.160468:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428549376:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772168.161016:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772168.162825:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428549504:0@lo:400:kworker.0 00000100:00100000:0.0:1790772168.162912:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772168.162956:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428550016:0@lo:400:kworker.0 00000100:00100000:0.0:1790772168.162980:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772168.163004:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772168.163009:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428549632:0@lo:400:kworker.0 00000100:00100000:0.0:1790772168.163035:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772168.163070:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428549632 00000100:00100000:0.0:1790772168.163079:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428549632 00000100:00100000:0.0:1790772168.163134:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790772168.163143:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428549632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772168.163203:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428549632:12345-0@lo:400:kworker.0 Request processed in 61us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772168.163211:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790772168.163357:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428549760:0@lo:400:kworker.0 00000100:00100000:0.0:1790772168.163386:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772168.163405:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772168.163411:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428549888:0@lo:400:kworker.0 00000100:00100000:0.0:1790772168.163449:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772168.163492:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428549632:0@lo:400:kworker.0 00000100:00100000:0.0:1790772168.163515:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428549760 00000100:00100000:0.0:1790772168.163518:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428549760 00000100:00100000:0.0:1790772168.163545:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428549888 00000100:00100000:0.0:1790772168.163577:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428549888 00000100:00100000:0.0:1790772168.163591:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790772168.163607:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428549760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772168.163640:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428549760:12345-0@lo:400:kworker.0 Request processed in 43us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772168.163646:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790772168.163768:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790772168.163778:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428549888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772168.163808:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428549888:12345-0@lo:400:kworker.0 Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772168.163814:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790772168.164776:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428550016 00000100:00100000:1.0:1790772168.164789:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428550016 00000100:00100000:1.0:1790772168.164846:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772168.164855:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1877760428550016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772168.164935:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1877760428550016:12345-0@lo:400:kworker.0 Request processed in 81us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772168.164942:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772168.164991:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428550016:0@lo:400:kworker.0 00000100:00080000:1.0:1790772168.165054:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772168.165061:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772168.165092:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428549888:0@lo:400:kworker.0 00000100:00100000:1.0:1790772168.165106:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428549760:0@lo:400:kworker.0 00000100:00100000:2.0:1790772168.169410:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428549504 00000100:00100000:2.0:1790772168.169431:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428549504 00000100:00100000:2.0:1790772168.169521:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1790772168.169532:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428549504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772168.169697:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3293:x1877760428549504:12345-0@lo:400:kworker.0 Request processed in 166us (6784us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.169706:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1790772168.169783:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428549504:0@lo:400:kworker.0 00000100:00100000:1.0:1790772168.231618:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772168.231680:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772168.231718:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772168.231934:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412829184 00000100:00100000:0.0:1790772168.231946:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412829184 00000100:00100000:0.0:1790772168.232027:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:0.0:1790772168.232039:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2350:x1877760412829184:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772168.232135:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2350:x1877760412829184:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 99us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772168.232144:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:3.0:1790772168.232402:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412829312 00000100:00100000:3.0:1790772168.232407:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412829312 00000100:00100000:3.0:1790772168.232453:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 152 00000100:00100000:3.0:1790772168.232462:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412829312:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772168.232505:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2350:x1877760412829312:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 44us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772168.232511:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 152 00000100:00080000:1.0:1790772168.233152:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772168.233177:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790772168.233584:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412829056 00000100:00100000:2.0:1790772168.233593:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412829056 00000100:00100000:2.0:1790772168.233910:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 293 00000100:00100000:2.0:1790772168.233921:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412829056:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772168.234000:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2350:x1877760412829056:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 81us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.234008:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 293 00000100:00100000:0.0:1790772168.247933:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.248141:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412829568 00000100:00100000:2.0:1790772168.248154:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412829568 00000100:00100000:2.0:1790772168.248249:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 194 00000100:00100000:2.0:1790772168.248261:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+33:11529:x1877760412829568:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772168.248307:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772168.248332:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cc0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.248417:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.248443:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.248455:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.248470:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.248477:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.248484:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.248838:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.248848:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.248854:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772168.248864:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790772168.249277:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249286:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249294:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249301:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772168.249306:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249314:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249328:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:2.0:1790772168.249332:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772168.249337:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249343:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90b94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249358:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249365:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249371:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249376:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772168.249387:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249393:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249401:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df25a490e00) 00010000:00010000:2.0:1790772168.249403:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772168.249406:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249411:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90b9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249459:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90b8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cc0 expref: 36 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249472:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cc0 expref: 35 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.249479:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:2.0:1790772168.249482:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790772168.249484:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa800, rc 0) 00000100:00100000:2.0:1790772168.249625:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:11529:x1877760412829568:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1365us (1704us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1790772168.249634:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 194 00000100:00100000:1.0:1790772168.252983:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772168.253174:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412829696 00000100:00100000:3.0:1790772168.253198:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412829696 00000100:00100000:3.0:1790772168.253392:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 195 00000100:00100000:3.0:1790772168.253405:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:11529:x1877760412829696:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:3.0:1790772168.253508:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.253529:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cab expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.253540:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.253828:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cab expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.253846:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cab expref: 35 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772168.253863:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eec000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428550144:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772168.254185:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2412ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772168.256923:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eec000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428550144:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772168.256965:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772168.260401:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.260699:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412829952 00000100:00100000:2.0:1790772168.260711:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412829952 00000100:00100000:2.0:1790772168.260776:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:2.0:1790772168.260787:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:5586:x1877760412829952:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790772168.261211:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+37:5586:x1877760412829952:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 424us (822us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1790772168.261220:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:3.0:1790772168.270937:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772168.273415:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412830080 00000100:00100000:1.0:1790772168.273510:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412830080 00010000:00010000:1.0:1790772168.273611:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cab expref: 37 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772168.273739:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:1.0:1790772168.273752:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+37:2347:x1877760412830080:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772168.273774:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772168.273783:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cab expref: 37 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.273797:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cab expref: 37 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.273825:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90b55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cab expref: 37 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.273847:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:1.0:1790772168.273854:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.273865:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.273948:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.274159:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772168.274259:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:2347:x1877760412830080:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 509us (3403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772168.274267:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 74 00010000:00010000:3.0:1790772168.278019:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.278041:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.278089:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.278099:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.278133:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.278140:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772168.278145:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.278153:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.278174:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:3.0:1790772168.278177:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772168.278182:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.278188:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772168.278486:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:11529:x1877760412829696:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 25078us (25510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772168.278497:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 195 00000100:00100000:3.0:1790772168.283195:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.283306:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412830336 00000100:00100000:2.0:1790772168.283320:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412830336 00000100:00100000:2.0:1790772168.283508:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:2.0:1790772168.283521:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+35:11529:x1877760412830336:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1790772168.283922:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:11529:x1877760412830336:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 402us (793us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1790772168.283932:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:0.0:1790772168.374920:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.375050:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412830592 00000100:00100000:2.0:1790772168.375063:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412830592 00000100:00100000:2.0:1790772168.375139:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 196 00000100:00100000:2.0:1790772168.375151:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+36:11540:x1877760412830592:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:2.0:1790772168.375182:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772168.375223:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90bb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cc7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.375694:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90bbe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.375714:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90bbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.375729:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90bbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.375746:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.375772:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.375779:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376124:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90bcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376135:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376143:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772168.376155:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1790772168.376821:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90bbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376832:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90bbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376840:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376847:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772168.376852:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376861:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90bbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376889:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:2.0:1790772168.376893:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772168.376898:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90bbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376904:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90bbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376920:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376927:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376932:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376937:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aba00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772168.376940:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376946:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376952:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df25a490e00) 00010000:00010000:2.0:1790772168.376954:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772168.376957:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90bc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.376962:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90bc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.377035:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90bb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cc7 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.377050:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cc7 expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.377057:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:2.0:1790772168.377059:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772168.377062:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa200, rc 0) 00000100:00100000:2.0:1790772168.377157:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+38:11540:x1877760412830592:12345-192.168.206.27@tcp:101:cat.0 Request processed in 2006us (2250us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1790772168.377166:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 196 00000100:00100000:3.0:1790772168.383241:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772168.384101:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412830848 00000100:00100000:1.0:1790772168.384118:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412830848 00000100:00100000:1.0:1790772168.384371:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00100000:1.0:1790772168.384385:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+38:11540:x1877760412830848:12345-192.168.206.27@tcp:35:cat.0 00000100:00100000:1.0:1790772168.385074:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+39:11540:x1877760412830848:12345-192.168.206.27@tcp:35:cat.0 Request processed in 687us (1842us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1790772168.385085:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00100000:3.0:1790772168.410922:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772168.410992:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412831104 00000100:00100000:3.0:1790772168.411006:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412831104 00000100:00100000:3.0:1790772168.411069:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 197 00000100:00100000:3.0:1790772168.411081:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+39:11541:x1877760412831104:12345-192.168.206.27@tcp:36:rm.0 00010000:00010000:3.0:1790772168.411157:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790772168.411229:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90bcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cc7 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.411255:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cc0 expref: 38 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.411267:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90b6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb2 expref: 37 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.412067:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07700) 00010000:00010000:3.0:1790772168.412082:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772168.412113:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90bda lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.412130:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90bda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.412141:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90bda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.412158:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.412165:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.412172:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.412913:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90be8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.412937:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.412945:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772168.415052:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1790772168.415069:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334559518883ns, next at 335559514905ns, rc = 0 00010000:00010000:3.0:1790772168.415161:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415181:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415252:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415262:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415268:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415350:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415520:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772168.415582:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415590:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90be8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415617:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90be8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415623:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772168.415628:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90be8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415637:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90be8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415662:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07200) 00010000:00010000:3.0:1790772168.415666:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790772168.415671:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90be8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415678:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90be8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415703:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90bda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415709:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90bda lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415714:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90bda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415720:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772168.415722:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90bda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415738:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90bda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415747:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:3.0:1790772168.415750:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772168.415753:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90bda lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.415758:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90bda lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772168.415770:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000096e3801f reply state 00000000a9c1aa58 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772168.415781:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772168.415908:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+38:11541:x1877760412831104:12345-192.168.206.27@tcp:36:rm.0 Request processed in 4822us (4994us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1790772168.415999:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 197 00010000:00010000:1.0:1790772168.417902:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.417924:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.417932:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.417939:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772168.417944:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.417953:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.417973:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df247e07d00) 00010000:00010000:1.0:1790772168.417993:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772168.418000:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.418006:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327000/0xdf68d9a7d6a90be1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.421977:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772168.421998:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.422012:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326c00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772168.422018:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.422030:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.422053:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df247e07200) 00010000:00010000:2.0:1790772168.422056:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790772168.422062:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.422097:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326c00/0xdf68d9a7d6a90bef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.422268:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772168.422271:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772168.422273:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772168.463213:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772168.463613:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412831360 00000100:00100000:0.0:1790772168.463628:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412831360 00000100:00100000:0.0:1790772168.463716:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 198 00000100:00100000:0.0:1790772168.463747:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+37:11547:x1877760412831360:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1790772168.463783:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772168.463809:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90bf6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cce expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.463973:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90bfd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.463993:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90bfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.464006:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90bfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.464022:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.464028:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.464034:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772168.464766:0:6701:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1790772168.464990:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465005:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465014:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465068:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90bfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465076:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90bfd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465084:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90bfd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465090:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772168.465095:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90bfd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465102:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90bfd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465116:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772168.465120:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772168.465125:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90bfd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465131:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a90bfd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772168.465148:0:6701:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000128ca380 reply state 0000000046ee52e6 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772168.465158:0:6701:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790772168.465194:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90bf6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cce expref: 40 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465221:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cce expref: 39 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.465228:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df254043000) 00010000:00010000:0.0:1790772168.465231:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772168.465233:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030200, rc 0) 00000100:00100000:0.0:1790772168.467475:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+40:11547:x1877760412831360:12345-192.168.206.27@tcp:101:bash.0 Request processed in 3715us (4260us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1790772168.467490:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 198 00010000:00010000:1.0:1790772168.470604:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.470626:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.470633:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.470640:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772168.470646:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.470750:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.470771:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df254043700) 00010000:00010000:1.0:1790772168.470774:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772168.470780:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.470785:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90c04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772168.472085:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772168.472168:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412831488 00000100:00100000:1.0:1790772168.472197:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412831488 00000100:00100000:1.0:1790772168.472261:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:1.0:1790772168.472271:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412831488:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1790772168.472293:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772168.472316:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a90c19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cd5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772168.472346:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790772168.472369:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1790772168.472374:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772168.472385:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a90c19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cd5 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.472407:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a90c19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cd5 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.472421:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8800, rc 0) 00000100:00100000:1.0:1790772168.472544:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412831488:12345-192.168.206.27@tcp:101:bash.0 Request processed in 274us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772168.472583:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:0.0:1790772168.476129:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.476233:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412831616 00000100:00100000:2.0:1790772168.476246:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412831616 00000100:00100000:2.0:1790772168.476317:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1790772168.476328:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:11547:x1877760412831616:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1790772168.476353:0:8509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772168.476375:0:8509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cdc expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.476411:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a90c19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cd5 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.476421:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772168.476426:0:8509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772168.476432:0:8509:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 7 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.476474:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a90c19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cd5 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.476490:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a90c19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cd5 expref: 7 pid: 6677 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772168.476533:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8509:1877760428550272:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772168.476703:0:8509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b82540 going to sleep for 11 seconds 00000100:00100000:0.0:1790772168.491355:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.491498:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8509:1877760428550272:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772168.491540:0:8509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 7 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.491635:0:8509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab200, rc 0) 00000100:00100000:2.0:1790772168.491716:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:11547:x1877760412831616:12345-192.168.206.27@tcp:101:bash.0 Request processed in 15388us (15600us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.491726:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:3.0:1790772168.492253:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412831744 00000100:00100000:3.0:1790772168.492262:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412831744 00010000:00010000:3.0:1790772168.492304:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a90c19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cd5 expref: 7 pid: 6677 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772168.492346:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:3.0:1790772168.492357:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412831744:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772168.492373:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772168.492418:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a90c19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cd5 expref: 7 pid: 6677 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.492433:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a90c19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cd5 expref: 7 pid: 6677 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.492461:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a90c19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cd5 expref: 7 pid: 6677 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.492479:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772168.492484:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772168.492493:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 6 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.492504:0:5808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 6 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.492795:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 6 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772168.492815:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1877760428550400:192.168.206.27@tcp:105: 00000100:00100000:2.0:1790772168.493952:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2412eda80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772168.504794:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1877760428550400:192.168.206.27@tcp:105: 00010000:00010000:2.0:1790772168.504834:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772168.504920:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412831744:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 12564us (13579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.504933:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:3.0:1790772168.509936:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.511068:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412832000 00000100:00100000:2.0:1790772168.511086:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412832000 00000100:00100000:2.0:1790772168.511197:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:2.0:1790772168.511209:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+39:11547:x1877760412832000:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:2.0:1790772168.511738:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+40:11547:x1877760412832000:12345-192.168.206.27@tcp:35:bash.0 Request processed in 528us (1816us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790772168.511747:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:0.0:1790772168.656195:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.658716:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412832128 00000100:00100000:2.0:1790772168.658739:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412832128 00000100:00100000:2.0:1790772168.658912:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 199 00000100:00100000:2.0:1790772168.658925:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+40:11563:x1877760412832128:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772168.658960:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772168.658989:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90c27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ce3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.659078:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90c2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.659096:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.659109:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772168.659152:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790772168.659157:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772168.659178:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.659208:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90c27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ce3 expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.659231:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90c2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ce3 expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.659241:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:2.0:1790772168.659244:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772168.659266:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab600, rc 0) 00000100:00100000:2.0:1790772168.659364:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:11563:x1877760412832128:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 442us (3184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.659372:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 199 00000100:00100000:3.0:1790772168.662605:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.662712:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412832384 00000100:00100000:2.0:1790772168.662724:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412832384 00000100:00100000:2.0:1790772168.662793:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 200 00000100:00100000:2.0:1790772168.662804:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+41:11563:x1877760412832384:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772168.662831:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772168.662858:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cea expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.663033:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90c3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.663049:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.663060:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772168.663071:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790772168.666099:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cea expref: 44 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.666785:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cea expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.666798:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df254043000) 00010000:00010000:2.0:1790772168.666817:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790772168.666821:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa200, rc 0) 00000100:00100000:2.0:1790772168.666923:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+43:11563:x1877760412832384:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 4120us (4339us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1790772168.666933:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 200 00000100:00100000:0.0:1790772168.671293:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772168.671414:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412832640 00000100:00100000:1.0:1790772168.671880:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772168.671902:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428550528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772168.671969:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772168.672095:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428550528 00000100:00100000:2.0:1790772168.672185:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428550528 00000100:00100000:2.0:1790772168.672246:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790772168.672256:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877760428550528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772168.672298:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772168.672347:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877760428550528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.672353:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790772168.672798:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428550528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772168.673521:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412832640 00000100:00100000:3.0:1790772168.673602:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 201 00000100:00100000:3.0:1790772168.673611:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+43:11563:x1877760412832640:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772168.673661:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772168.673687:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90c4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cf1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.673795:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90c51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.673810:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.673822:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772168.673835:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790772168.673974:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90c4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cf1 expref: 46 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.673992:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cf1 expref: 45 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.674001:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df254043000) 00010000:00010000:3.0:1790772168.674004:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790772168.674007:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241326800, rc 0) 00000100:00100000:3.0:1790772168.674076:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+45:11563:x1877760412832640:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 466us (2794us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1790772168.674083:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 201 00000100:00100000:0.0:1790772168.674238:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772168.674384:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412832768 00000100:00100000:0.0:1790772168.674390:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412832768 00000100:00100000:0.0:1790772168.675502:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1790772168.675517:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246094850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+45:2347:x1877760412832768:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772168.675533:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772168.675576:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90c3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cea expref: 45 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.675591:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df254043000) 00010000:00010000:0.0:1790772168.675604:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772168.675659:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246094850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+44:2347:x1877760412832768:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 137us (4306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772168.677941:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1790772168.688841:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772168.688944:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412832896 00000100:00100000:1.0:1790772168.688958:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412832896 00000100:00100000:1.0:1790772168.689041:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:1.0:1790772168.689052:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+6:2348:x1877760412832896:12345-192.168.206.27@tcp:1:lfs.0 00010000:00010000:1.0:1790772168.689106:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.689130:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 6 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.689150:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772168.689155:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790772168.689160:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.689202:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 6 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.689218:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 6 pid: 8509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772168.689234:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1877760428550656:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772168.689343:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772168.691868:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1877760428550656:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772168.691905:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772168.695505:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772168.695822:0:6683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412833024 00000100:00100000:1.0:1790772168.695835:0:6683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412833024 00002000:00100000:1.0:1790772168.695916:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8df26fa04700 x1877760412833024/t0(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:514/0 lens 504/0 e 0 to 0 dl 1790772179 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772168.695930:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df26fa04700 with x1877760412833024 ext(0->8) 00010000:00010000:1.0:1790772168.695960:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 7 pid: 8509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.695981:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 7 pid: 8509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772168.695991:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df26fa04700 00000100:00100000:1.0:1790772168.696029:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:1.0:1790772168.696040:0:6683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412833024:12345-192.168.206.27@tcp:4:lfs.0 00000100:00100000:1.0:1790772168.700090:0:6683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2347:x1877760412833024:12345-192.168.206.27@tcp:4:lfs.0 Request processed in 4036us (4581us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790772168.700108:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00002000:00100000:1.0:1790772168.700125:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8df26fa04700 x1877760412833024/t4294967308(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:514/0 lens 504/448 e 0 to 0 dl 1790772179 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790772168.702674:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772168.702895:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412833152 00000100:00100000:0.0:1790772168.702907:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412833152 00010000:00010000:0.0:1790772168.702952:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 10 pid: 8509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772168.703003:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 76 00000100:00100000:0.0:1790772168.703011:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:2348:x1877760412833152:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772168.703029:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790772168.703052:0:7617:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790772168.703055:0:7617:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790772167 00002000:00010000:0.0:1790772168.703058:0:7617:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790772168 00002000:00010000:0.0:1790772168.703060:0:7617:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790772167 00010000:00010000:0.0:1790772168.703066:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 10 pid: 8509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.703079:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 10 pid: 8509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.703102:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d74bc6d/0xdf68d9a7d6a90c20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cdc expref: 10 pid: 8509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.703121:0:7617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772168.703126:0:7617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772168.703144:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.703154:0:7617:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.703183:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772168.703244:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2348:x1877760412833152:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 232us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772168.703251:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 76 00010000:00010000:2.0:1790772168.703356:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.703370:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.703401:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.703437:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.703448:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.703457:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772168.703462:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.703473:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.703486:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.703494:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a90c5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772168.703608:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412832896:12345-192.168.206.27@tcp:1:lfs.0 Request processed in 14556us (14779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.703617:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 61 00002000:00100000:1.0:1790772168.704100:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df26fa04700 with x1877760412833024 ext(0->8) 00010000:00010000:1.0:1790772168.704107:0:6683:0:(ldlm_extent.c:823:ldlm_resource_prolong()) Failed to get resource for resid 9663677440/5 00002000:00010000:1.0:1790772168.704111:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df26fa04700 00000100:00100000:3.0:1790772168.710300:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.713506:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412833408 00000100:00100000:2.0:1790772168.713535:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412833408 00000100:00100000:2.0:1790772168.713659:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:2.0:1790772168.713696:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25db8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+44:11563:x1877760412833408:12345-192.168.206.27@tcp:35:lfs.0 00000004:00010000:2.0:1790772168.713802:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cf1 expref: 44 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772168.714144:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1790772168.714180:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1790772168.717166:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1790772168.718413:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.718446:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cce expref: 48 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.718455:0:5826:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.718507:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cce expref: 48 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.718528:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cce expref: 48 pid: 6701 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772168.718546:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5826:1877760428550784:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772168.719535:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772168.729995:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772168.732281:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412833536 00000100:00100000:1.0:1790772168.732302:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412833536 00010000:00010000:1.0:1790772168.732365:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cce expref: 49 pid: 6701 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772168.732422:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:1.0:1790772168.732431:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+49:2347:x1877760412833536:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772168.732451:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772168.732474:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cce expref: 49 pid: 6701 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.732489:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cce expref: 49 pid: 6701 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.732516:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df254043000) 00010000:00010000:1.0:1790772168.732522:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.732534:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.732542:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.732852:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772168.732930:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+49:2347:x1877760412833536:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 499us (2948us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772168.732939:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 77 00010000:00010000:2.0:1790772168.736626:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cce expref: 48 pid: 6701 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772168.736659:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5826:1877760428550784:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772168.736715:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.736726:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.736732:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772168.736796:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790772168.736899:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1790772168.737155:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1790772168.737366:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877760428550912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790772168.737448:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772168.737620:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b82a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772168.737839:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428550912 00000100:00100000:1.0:1790772168.737847:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428550912 00000100:00100000:1.0:1790772168.737946:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772168.737958:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1877760428550912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790772168.738057:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1877760428550912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772168.738066:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772168.738131:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877760428550912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790772168.738733:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1790772168.738807:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877760428551040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790772168.738860:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772168.739271:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772168.739324:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428551040 00000100:00100000:0.0:1790772168.739331:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428551040 00000100:00100000:0.0:1790772168.739368:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790772168.739378:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1877760428551040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790772168.739622:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5826:x1877760428551040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 245us (762us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790772168.739630:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772168.739789:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877760428551040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790772168.739850:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1790772168.739895:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.739907:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.739916:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.739938:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772168.739943:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.739952:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.739970:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df254043000) 00010000:00010000:2.0:1790772168.739973:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790772168.739979:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.739985:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c66 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790772168.740190:0:5826:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790772168.740310:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1790772168.740323:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334884773338ns, next at 335884771004ns, rc = 0 00000001:00080000:2.0:1790772168.740330:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1790772168.740367:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df254043000) 00010000:00010000:2.0:1790772168.740370:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790772168.740378:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326800/0xdf68d9a7d6a90c51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cf1 expref: 52 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772168.740484:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25db8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+51:11563:x1877760412833408:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 26791us (30196us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1790772168.740494:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 56 00000020:00080000:2.0:1790772168.740499:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790772168.743865:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.743985:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412833664 00000100:00100000:2.0:1790772168.743997:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412833664 00000100:00100000:2.0:1790772168.744055:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 202 00000100:00100000:2.0:1790772168.744066:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+51:11563:x1877760412833664:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772168.744096:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772168.744126:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90c6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cf8 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.744364:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cf8 expref: 52 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.744384:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cf8 expref: 52 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.744409:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:2.0:1790772168.744412:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772168.744416:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aba00, rc 0) 00000100:00100000:2.0:1790772168.744490:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+52:11563:x1877760412833664:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 426us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.744498:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 202 00000100:00100000:0.0:1790772168.748462:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772168.749096:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412833920 00000100:00100000:1.0:1790772168.749127:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412833920 00000100:00100000:1.0:1790772168.749247:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:1.0:1790772168.749259:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+52:11563:x1877760412833920:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:1.0:1790772168.749627:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:11563:x1877760412833920:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 369us (1179us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1790772168.749636:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:3.0:1790772168.842817:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772168.843443:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412834048 00000100:00100000:0.0:1790772168.843458:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412834048 00000100:00100000:0.0:1790772168.843539:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 203 00000100:00100000:0.0:1790772168.843625:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:11573:x1877760412834048:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:0.0:1790772168.843733:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.843756:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.843842:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.843864:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90c7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.843872:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.843880:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844127:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844137:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844144:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772168.844196:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844368:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844377:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844384:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844456:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772168.844462:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844471:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844485:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772168.844488:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772168.844493:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844499:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90c74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844517:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844524:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90c7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844531:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844536:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772168.844539:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844545:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90c7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844682:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df254043400) 00010000:00010000:0.0:1790772168.844684:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772168.844687:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90c7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844693:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90c7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844710:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844716:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844722:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844727:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772168.844729:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844734:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844740:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772168.844742:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772168.844745:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772168.844750:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90c82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772168.845083:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:11573:x1877760412834048:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 1531us (2283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772168.845093:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 203 00000100:00100000:0.0:1790772168.921163:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.929441:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412834304 00000100:00100000:2.0:1790772168.929463:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412834304 00000100:00100000:2.0:1790772168.929659:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 204 00000100:00100000:2.0:1790772168.929672:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+53:11576:x1877760412834304:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772168.929700:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772168.929730:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226cff expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.929863:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90c90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.929896:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90c90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.929913:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90c90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.929930:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90c97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.929938:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.929946:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.930112:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.930121:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.930129:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772168.930141:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790772168.937748:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90c90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.937771:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90c90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.937781:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.937787:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772168.937793:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.937802:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90c90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.937823:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:3.0:1790772168.937826:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772168.937832:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90c90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.937840:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90c90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.937859:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.937865:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90c97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.938413:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.938783:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abe00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772168.938787:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.938796:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90c97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.938810:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df25a490d00) 00010000:00010000:3.0:1790772168.938813:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772168.938817:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90c97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.938824:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90c97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.938923:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90c89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cff expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.938941:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cff expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772168.938949:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:3.0:1790772168.938951:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772168.938954:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aae00, rc 0) 00000100:00100000:3.0:1790772168.939054:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:11576:x1877760412834304:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 9383us (17904us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1790772168.939065:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 204 00000100:00100000:1.0:1790772168.955246:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.955841:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412834432 00000100:00100000:2.0:1790772168.955856:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412834432 00000100:00100000:2.0:1790772168.955942:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 205 00000100:00100000:2.0:1790772168.955971:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:11576:x1877760412834432:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:2.0:1790772168.956062:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.956085:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.956099:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.956133:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.956142:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.956150:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.956157:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772168.956161:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.956170:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.956183:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:2.0:1790772168.956187:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772168.956193:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772168.956200:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772168.956329:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:11576:x1877760412834432:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 359us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772168.956338:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 205 00000100:00100000:0.0:1790772168.958621:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772168.958727:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412834688 00000100:00100000:2.0:1790772168.958738:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412834688 00000100:00100000:2.0:1790772168.958861:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:2.0:1790772168.958883:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+55:11576:x1877760412834688:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1790772168.959320:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:11576:x1877760412834688:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 448us (710us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1790772168.959329:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:3.0:1790772169.035113:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.035785:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412834944 00000100:00100000:0.0:1790772169.035801:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412834944 00000100:00100000:1.0:1790772169.036157:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 206 00000100:00100000:1.0:1790772169.036170:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:11586:x1877760412834944:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1790772169.036221:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772169.036232:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790772169.036269:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90c2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ce3 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.036292:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:1.0:1790772169.036298:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790772169.036314:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90cb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d06 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.036436:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.036452:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cff expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.036462:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.036514:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cff expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.036529:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cff expref: 56 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772169.036546:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428551168:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772169.036881:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772169.039830:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772169.039917:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412835072 00000100:00100000:3.0:1790772169.039929:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412835072 00010000:00010000:3.0:1790772169.039979:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cff expref: 57 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.040024:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:3.0:1790772169.040034:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:2348:x1877760412835072:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772169.040051:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772169.040058:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cff expref: 57 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.040072:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cff expref: 57 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.040097:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:3.0:1790772169.040103:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.040114:0:7617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.040133:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.040154:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772169.040227:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+57:2348:x1877760412835072:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 194us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772169.040240:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 78 00010000:00010000:1.0:1790772169.041108:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90c9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cff expref: 56 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772169.041189:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428551168:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772169.041359:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.041371:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.041377:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772169.041401:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790772169.041969:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90cb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d06 expref: 57 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.041989:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d06 expref: 56 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.042021:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:1.0:1790772169.042024:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790772169.042028:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9600, rc 0) 00000100:00100000:1.0:1790772169.042150:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:11586:x1877760412834944:12345-192.168.206.27@tcp:101:bash.0 Request processed in 5982us (7052us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1790772169.042160:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 206 00000100:00100000:0.0:1790772169.046182:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.046325:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412835328 00000100:00100000:2.0:1790772169.046337:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412835328 00000100:00100000:2.0:1790772169.046404:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 207 00000100:00100000:2.0:1790772169.046415:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+56:11586:x1877760412835328:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:2.0:1790772169.046768:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.046790:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.046802:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772169.046853:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1790772169.046883:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000385cea46 reply state 00000000de799f67 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.046915:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772169.047017:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11586:x1877760412835328:12345-192.168.206.27@tcp:36:bash.0 Request processed in 603us (848us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1790772169.047025:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 207 00000020:00080000:2.0:1790772169.047030:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790772169.050291:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772169.050439:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412835456 00000100:00100000:3.0:1790772169.050464:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412835456 00000100:00100000:3.0:1790772169.050530:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 208 00000100:00100000:3.0:1790772169.050541:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11586:x1877760412835456:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1790772169.050621:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772169.050647:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90ccf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d0d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.050778:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.050795:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d06 expref: 60 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.050802:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.050809:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.050829:0:5823:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.050858:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d06 expref: 60 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.050884:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d06 expref: 60 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.050900:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428551296:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772169.050963:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.050973:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.050980:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.050986:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772169.050989:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.050997:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.050999:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2412ed900 going to sleep for 11 seconds 00010000:00010000:1.0:1790772169.051014:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:1.0:1790772169.051018:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772169.051021:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.051030:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.051048:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90cc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772169.054326:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.054499:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412835584 00000100:00100000:2.0:1790772169.054510:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412835584 00010000:00010000:2.0:1790772169.054599:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d06 expref: 60 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.054637:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:2.0:1790772169.054647:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:2347:x1877760412835584:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772169.054831:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772169.054840:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d06 expref: 60 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.054855:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d06 expref: 60 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.054889:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:2.0:1790772169.054895:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.054907:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.054916:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.054953:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772169.055016:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:2347:x1877760412835584:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 370us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772169.055024:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 79 00010000:00010000:3.0:1790772169.055627:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d06 expref: 59 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.055648:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877760428551296:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772169.055676:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.055687:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.055693:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772169.055750:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790772169.055755:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772169.055779:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.055816:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90ccf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d0d expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.055832:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d0d expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.055839:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:3.0:1790772169.055842:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772169.055845:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241327e00, rc 0) 00000100:00100000:3.0:1790772169.055895:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:11586:x1877760412835456:12345-192.168.206.27@tcp:101:bash.0 Request processed in 5355us (5617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772169.055913:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 208 00000100:00100000:1.0:1790772169.058425:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.058623:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412835840 00000100:00100000:2.0:1790772169.058636:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412835840 00000100:00100000:2.0:1790772169.058708:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:2.0:1790772169.058719:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+58:11586:x1877760412835840:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:2.0:1790772169.059302:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11586:x1877760412835840:12345-192.168.206.27@tcp:35:bash.0 Request processed in 582us (890us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1790772169.059313:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:0.0:1790772169.130485:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.130689:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412835968 00000100:00100000:2.0:1790772169.130702:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412835968 00000100:00100000:2.0:1790772169.130777:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 209 00000100:00100000:2.0:1790772169.130790:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+59:11592:x1877760412835968:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772169.130818:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772169.130842:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90cdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d14 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.130959:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90ce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.130975:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.130988:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772169.131038:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790772169.131042:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772169.131062:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.131088:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90cdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d14 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.131106:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d14 expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.131115:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:2.0:1790772169.131118:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772169.131121:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab200, rc 0) 00000100:00100000:2.0:1790772169.131192:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11592:x1877760412835968:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 405us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772169.131199:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 209 00000100:00100000:2.0:1790772169.134508:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772169.134628:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412836096 00000100:00100000:1.0:1790772169.134640:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412836096 00000100:00100000:1.0:1790772169.134710:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 210 00000100:00100000:1.0:1790772169.134721:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11592:x1877760412836096:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772169.134747:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772169.134773:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ceb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d1b expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.134862:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cf2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.134938:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.134950:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.134966:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.134972:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.134978:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135097:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135105:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135112:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772169.135281:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790772169.135286:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772169.135306:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135320:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135328:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135334:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cf2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135341:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135347:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772169.135352:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135360:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cf2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135380:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:1.0:1790772169.135383:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772169.135388:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135395:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9600/0xdf68d9a7d6a90cf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135410:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135417:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135423:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135428:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772169.135430:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135436:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135442:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df27c001300) 00010000:00010000:1.0:1790772169.135444:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772169.135446:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90cf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135451:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a90cf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135500:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9400/0xdf68d9a7d6a90ceb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d1b expref: 62 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135515:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d1b expref: 61 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.135522:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:1.0:1790772169.135524:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772169.135527:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9c00, rc 0) 00000100:00100000:1.0:1790772169.135705:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11592:x1877760412836096:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 986us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772169.135713:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 210 00000100:00100000:1.0:1790772169.144000:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772169.144042:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.144127:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412836352 00000100:00100000:2.0:1790772169.144138:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412836352 00000100:00100000:2.0:1790772169.144216:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 211 00000100:00100000:2.0:1790772169.144227:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11592:x1877760412836352:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772169.144256:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772169.144284:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d22 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.144402:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.144433:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d0d expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.144442:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d1b expref: 62 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.144450:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.144490:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d1b expref: 62 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.144505:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d1b expref: 62 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.144523:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428551424:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772169.144672:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d0d expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.144680:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d0d expref: 62 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.144689:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428551552:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772169.144710:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b82f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772169.145505:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412836480 00000100:00100000:3.0:1790772169.145515:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412836480 00010000:00010000:3.0:1790772169.145577:0:7617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d1b expref: 63 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.145631:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:3.0:1790772169.145641:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+63:2348:x1877760412836480:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772169.145655:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772169.145662:0:7617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d1b expref: 63 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.145675:0:7617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d1b expref: 63 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.145699:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:3.0:1790772169.145704:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.145713:0:7617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.145720:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772169.145769:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+63:2348:x1877760412836480:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 129us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772169.145777:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 80 00010000:00010000:2.0:1790772169.155662:0:5824:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.27@tcp) returned -22 from blocking AST (req@00000000f34db913 x1877760428551424) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d1b expref: 62 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.155727:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9c00/0xdf68d9a7d6a90d00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d1b expref: 62 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.155749:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428551424:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772169.162071:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428551552:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772169.162115:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:2.0:1790772169.162133:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.162145:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.162155:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772169.168464:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.168600:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412836608 00000100:00100000:0.0:1790772169.168613:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412836608 00010000:00010000:0.0:1790772169.168665:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d0d expref: 62 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.168715:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 81 00000100:00100000:0.0:1790772169.168726:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+62:2347:x1877760412836608:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772169.168745:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772169.168754:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d0d expref: 62 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.168770:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d0d expref: 62 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.168796:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327e00/0xdf68d9a7d6a90cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d0d expref: 62 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.168836:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772169.168842:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.168854:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.168864:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.168899:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772169.168951:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.168960:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.168961:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:2347:x1877760412836608:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 237us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.168969:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 81 00000004:00200000:2.0:1790772169.168985:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790772169.169258:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d22 expref: 62 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.169276:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d22 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.169295:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:2.0:1790772169.169298:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790772169.169300:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa200, rc 0) 00000100:00100000:2.0:1790772169.169329:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11592:x1877760412836352:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 25105us (25342us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1790772169.169336:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 211 00000100:00100000:1.0:1790772169.173125:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772169.173355:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412836864 00000100:00100000:3.0:1790772169.173385:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412836864 00000100:00100000:3.0:1790772169.173502:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:3.0:1790772169.173513:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246096450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11592:x1877760412836864:12345-192.168.206.27@tcp:103:lfs.0 00010000:00010000:3.0:1790772169.173534:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772169.173583:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90c6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cf8 expref: 61 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.173619:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:3.0:1790772169.173625:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772169.173875:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246096450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11592:x1877760412836864:12345-192.168.206.27@tcp:103:lfs.0 Request processed in 352us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772169.173885:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:1.0:1790772169.176200:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772169.176363:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412836992 00000100:00100000:3.0:1790772169.176374:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412836992 00000100:00100000:3.0:1790772169.176446:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 212 00000100:00100000:3.0:1790772169.176465:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11592:x1877760412836992:12345-192.168.206.27@tcp:58:lfs.0 00010000:00010000:3.0:1790772169.176634:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.176665:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.176678:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772169.176931:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1790772169.177041:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11592:x1877760412836992:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 585us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772169.177050:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 212 00000100:00100000:1.0:1790772169.180528:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.180612:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412837120 00000100:00100000:0.0:1790772169.180626:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412837120 00000100:00100000:0.0:1790772169.180689:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 213 00000100:00100000:0.0:1790772169.180701:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+60:11592:x1877760412837120:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772169.180729:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772169.180754:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90d23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d29 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.180827:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.180839:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90d23 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d29 expref: 61 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.180887:0:5825:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.180903:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90d23 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d29 expref: 61 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.180919:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772169.180922:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772169.180926:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90d23 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d29 expref: 61 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.180934:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031200, rc 0) 00000100:00100000:0.0:1790772169.181012:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11592:x1877760412837120:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 312us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.181019:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 213 00000040:00080000:1.0:1790772169.184808:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790772169.184819:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772169.185017:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:1.0:1790772169.185026:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772169.185317:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f552300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428551680:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790772169.185439:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24927b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772169.191312:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f552300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428551680:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790772169.192260:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772169.192587:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412837248 00000100:00100000:3.0:1790772169.192608:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412837248 00000100:00100000:3.0:1790772169.192673:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 214 00000100:00100000:3.0:1790772169.192698:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11593:x1877760412837248:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790772169.192743:0:5823:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790772169.192857:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11593:x1877760412837248:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 161us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772169.192865:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 214 00000100:00100000:1.0:1790772169.196729:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.196988:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412837376 00000100:00100000:2.0:1790772169.197001:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412837376 00000100:00100000:2.0:1790772169.197068:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 215 00000100:00100000:2.0:1790772169.197080:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11593:x1877760412837376:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790772169.197186:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d2a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197220:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197242:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197261:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197269:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197285:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197313:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197322:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197329:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772169.197376:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790772169.197381:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772169.197398:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197411:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197418:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d2a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197425:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197432:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772169.197437:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197445:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d2a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197793:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:2.0:1790772169.197797:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772169.197803:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197810:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90d2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197826:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197833:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d31 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197839:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197843:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aba00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772169.197846:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197852:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d31 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.197860:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8df25a490d00) 00010000:00010000:2.0:1790772169.197862:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772169.198009:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d31 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.198018:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.198048:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.198055:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.198061:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.198067:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abe00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772169.198070:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.198076:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.198084:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:2.0:1790772169.198087:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772169.198089:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.198095:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.198270:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11593:x1877760412837376:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 Request processed in 1188us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772169.198280:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 215 00000100:00100000:0.0:1790772169.206947:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772169.207097:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412837632 00000100:00100000:3.0:1790772169.207111:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412837632 00000100:00100000:3.0:1790772169.207199:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 216 00000100:00100000:3.0:1790772169.207211:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+61:11593:x1877760412837632:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772169.207413:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772169.207456:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327a00/0xdf68d9a7d6a90d3f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d30 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.207645:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90d46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.207938:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.207956:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772169.207972:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790772169.208094:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.208102:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90d46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.208109:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.208141:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772169.208146:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.208214:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90d46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.208290:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:3.0:1790772169.208295:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790772169.208301:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90d46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.208308:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90d46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.208362:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327a00/0xdf68d9a7d6a90d3f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d30 expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.208373:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:3.0:1790772169.208375:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772169.208380:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327a00/0xdf68d9a7d6a90d3f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d30 expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.208390:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241327a00, rc 0) 00000100:00100000:3.0:1790772169.208468:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+62:11593:x1877760412837632:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1259us (1533us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1790772169.208477:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 216 00000100:00100000:1.0:1790772169.213883:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.213995:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412837760 00000100:00100000:2.0:1790772169.214009:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412837760 00000100:00100000:2.0:1790772169.214118:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 217 00000100:00100000:2.0:1790772169.214148:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+62:11593:x1877760412837760:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790772169.214210:0:5824:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790772169.214448:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+62:11593:x1877760412837760:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 303us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772169.214458:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 217 00000100:00100000:1.0:1790772169.221098:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.221211:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412838016 00000100:00100000:0.0:1790772169.221231:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412838016 00000100:00100000:0.0:1790772169.221309:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 218 00000100:00100000:0.0:1790772169.221320:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+62:11593:x1877760412838016:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772169.221349:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772169.221354:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790772169.221389:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a90ce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d14 expref: 62 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.221415:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772169.221438:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772169.221456:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90d54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d37 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772169.221989:0:6701:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1790772169.222192:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90d5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.222209:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90d5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.222222:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90d5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.222287:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90d54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d37 expref: 64 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.222307:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90d5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d37 expref: 63 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.222313:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043400) 00010000:00010000:0.0:1790772169.222316:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772169.222319:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030600, rc 0) 00000100:00100000:0.0:1790772169.222409:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+63:11593:x1877760412838016:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1090us (1338us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1790772169.222418:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 218 00000100:00100000:1.0:1790772169.227140:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.227492:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412838272 00000100:00100000:0.0:1790772169.227506:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412838272 00000100:00100000:0.0:1790772169.227855:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 219 00000100:00100000:0.0:1790772169.227876:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+63:11593:x1877760412838272:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772169.227958:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772169.227989:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90d5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d37 expref: 63 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228009:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043400) 00010000:00010000:0.0:1790772169.228019:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772169.228044:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90d69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228060:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90d69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228070:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90d69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228085:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90d70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1e507788 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228091:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90d70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e507788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228098:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90d70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e507788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228169:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90d69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228177:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90d69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228184:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90d69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228209:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772169.228214:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90d69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228230:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90d69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228240:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772169.228243:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772169.228247:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90d69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228254:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90d69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228264:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90d70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e507788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228271:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90d70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e507788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228277:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90d70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e507788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228282:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772169.228285:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90d70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e507788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228291:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90d70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e507788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228308:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1e507788 (ffff8df254043800) 00010000:00010000:0.0:1790772169.228310:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772169.228313:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90d70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1e507788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.228320:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a90d70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1e507788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.228412:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+62:11593:x1877760412838272:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 547us (1861us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772169.228419:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 219 00000100:00100000:3.0:1790772169.230628:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.233233:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412838400 00000100:00100000:0.0:1790772169.233253:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412838400 00000100:00100000:0.0:1790772169.233338:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 220 00000100:00100000:0.0:1790772169.233349:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+62:11593:x1877760412838400:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772169.233377:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772169.233406:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a90d77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d3e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.233449:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.233463:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.233476:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.233623:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a90d77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d3e expref: 64 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.233664:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d3e expref: 63 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.233674:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043000) 00010000:00010000:0.0:1790772169.233677:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790772169.233681:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030200, rc 0) 00000100:00100000:0.0:1790772169.233976:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+63:11593:x1877760412838400:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 627us (3359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.233984:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 220 00000100:00100000:3.0:1790772169.236809:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772169.236856:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412838656 00000100:00100000:3.0:1790772169.236867:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412838656 00000100:00100000:3.0:1790772169.236936:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 221 00000100:00100000:3.0:1790772169.236947:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+63:11593:x1877760412838656:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790772169.237051:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.237072:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.237085:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772169.237417:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:3.0:1790772169.237515:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000096f63ad reply state 0000000023597484 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.237526:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772169.237684:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+65:11593:x1877760412838656:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 737us (886us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1790772169.237691:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 221 00010000:00010000:0.0:1790772169.240899:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.240922:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.240930:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.240937:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772169.240943:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.240953:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.240973:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043000) 00010000:00010000:0.0:1790772169.240976:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790772169.240981:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.241008:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326200/0xdf68d9a7d6a90d85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.241516:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.242003:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412838784 00000100:00100000:2.0:1790772169.242015:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412838784 00000100:00100000:0.0:1790772169.242135:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 222 00000100:00100000:0.0:1790772169.242149:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+64:11593:x1877760412838784:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772169.242178:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772169.242200:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90d8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d45 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.242285:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90d8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d45 expref: 65 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.242301:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90d8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d45 expref: 65 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.242324:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043000) 00010000:00010000:0.0:1790772169.242327:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772169.242330:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031e00, rc 0) 00000100:00100000:0.0:1790772169.242407:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+65:11593:x1877760412838784:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 261us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.242415:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 222 00000100:00100000:3.0:1790772169.245277:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.245501:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412838912 00000100:00100000:0.0:1790772169.245513:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412838912 00000100:00100000:1.0:1790772169.246432:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:1.0:1790772169.246451:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2347:x1877760412838912:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790772169.247263:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:2347:x1877760412838912:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 813us (1993us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1790772169.247274:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:3.0:1790772169.250390:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.250587:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412839168 00000100:00100000:2.0:1790772169.250609:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412839168 00000100:00100000:2.0:1790772169.250697:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1790772169.250708:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+65:11593:x1877760412839168:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790772169.251028:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+66:11593:x1877760412839168:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 321us (649us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1790772169.251036:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:0.0:1790772169.255889:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.256012:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412839424 00000100:00100000:2.0:1790772169.256024:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412839424 00000100:00100000:2.0:1790772169.256093:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 223 00000100:00100000:2.0:1790772169.256103:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+66:11593:x1877760412839424:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790772169.256377:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+66:11593:x1877760412839424:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 274us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772169.256387:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 223 00000100:00100000:3.0:1790772169.263852:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.264034:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412839552 00000100:00100000:2.0:1790772169.264048:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412839552 00000100:00100000:2.0:1790772169.264119:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 224 00000100:00100000:2.0:1790772169.264131:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+66:11593:x1877760412839552:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772169.264178:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772169.264205:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.264370:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.264388:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.264402:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772169.264447:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772169.264471:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.264500:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90d93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d4c expref: 68 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.264521:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d4c expref: 67 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.264531:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043000) 00010000:00010000:2.0:1790772169.264534:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790772169.264538:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aba00, rc 0) 00000100:00100000:2.0:1790772169.265707:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+67:11593:x1877760412839552:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1570us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772169.266326:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 224 00000100:00100000:3.0:1790772169.270806:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.272347:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412839680 00000100:00100000:0.0:1790772169.272363:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412839680 00000100:00100000:0.0:1790772169.272535:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:0.0:1790772169.272579:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+10:2348:x1877760412839680:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772169.272615:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772169.272644:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a90da1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d53 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772169.272678:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd03c8, blocks: 0x1 00010000:00010000:0.0:1790772169.272704:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1790772169.272719:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772169.272732:0:6678:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a90da1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d53 expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.272754:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a90da1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d53 expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.272770:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031a00, rc 0) 00000100:00100000:0.0:1790772169.272856:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:2348:x1877760412839680:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 278us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.272863:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:1.0:1790772169.276307:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.276485:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412839936 00000100:00100000:0.0:1790772169.276497:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412839936 00000100:00100000:0.0:1790772169.276614:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 225 00000100:00100000:0.0:1790772169.276627:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+67:11593:x1877760412839936:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790772169.276780:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+67:11593:x1877760412839936:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 155us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.276788:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 225 00000100:00100000:3.0:1790772169.279968:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.280208:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412840064 00000100:00100000:0.0:1790772169.280220:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412840064 00000100:00100000:0.0:1790772169.280299:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:0.0:1790772169.280310:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:11593:x1877760412840064:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772169.280333:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772169.280356:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d5a expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.280395:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a90da1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d53 expref: 12 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.280404:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772169.280409:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772169.280415:0:6679:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.280456:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a90da1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d53 expref: 12 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.280472:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a90da1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d53 expref: 12 pid: 6678 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.280488:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27af06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1877760428551808:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772169.280674:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142acce40 going to sleep for 11 seconds 00000100:00100000:3.0:1790772169.283821:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.284045:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412840192 00000100:00100000:2.0:1790772169.284058:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412840192 00010000:00010000:2.0:1790772169.284110:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a90da1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d53 expref: 13 pid: 6678 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.284174:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:2.0:1790772169.284184:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:2347:x1877760412840192:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772169.284213:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772169.284249:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a90da1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d53 expref: 13 pid: 6678 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.284266:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a90da1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d53 expref: 13 pid: 6678 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.284297:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772169.284302:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772169.284312:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 13 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.284324:0:5810:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 13 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.284371:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 13 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.284389:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1877760428551936:192.168.206.27@tcp:105: 00000100:00100000:2.0:1790772169.284496:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b829c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790772169.285122:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a90da1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d53 expref: 13 pid: 6678 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.285156:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27af06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1877760428551808:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772169.285186:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.285210:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031c00, rc 0) 00000100:00100000:0.0:1790772169.285356:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+12:11593:x1877760412840064:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 5048us (5399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.285365:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:2.0:1790772169.290132:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1877760428551936:192.168.206.27@tcp:105: 00010000:00010000:2.0:1790772169.290166:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772169.290235:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:2347:x1877760412840192:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 6052us (6428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772169.290248:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:2.0:1790772169.294934:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772169.295098:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412840320 00000100:00100000:1.0:1790772169.295113:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412840320 00002000:00100000:1.0:1790772169.295176:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8df27ae0c700 x1877760412840320/t0(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:515/0 lens 504/0 e 0 to 0 dl 1790772180 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772169.295188:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27ae0c700 with x1877760412840320 ext(0->12) 00002000:00010000:1.0:1790772169.295195:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27ae0c700 00000100:00100000:1.0:1790772169.295240:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1790772169.295251:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+11:2347:x1877760412840320:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790772169.295841:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:2347:x1877760412840320:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 Request processed in 588us (917us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1790772169.295851:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00002000:00100000:1.0:1790772169.295858:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8df27ae0c700 x1877760412840320/t4294967320(0) o4->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:515/0 lens 504/448 e 0 to 0 dl 1790772180 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790772169.295878:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27ae0c700 with x1877760412840320 ext(0->12) 00002000:00010000:1.0:1790772169.295882:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27ae0c700 00000100:00100000:3.0:1790772169.300438:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.300639:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412840448 00000100:00100000:0.0:1790772169.300652:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412840448 00000100:00100000:0.0:1790772169.300735:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 226 00000100:00100000:0.0:1790772169.300747:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+67:11593:x1877760412840448:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790772169.383392:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000020:00080000:0.0:1790772169.383431:0:5845:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1790772169.383444:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1790772169.383468:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1790772169.383488:0:5845:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df142b82a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1790772169.383493:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df243106d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df142b82cc0 00000020:00080000:0.0:1790772169.383497:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df243106300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df27fca0400 00000020:00080000:0.0:1790772169.383539:0:5845:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df242f510c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1790772169.383544:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df27c033c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df247cc1840 00000020:00080000:0.0:1790772169.383579:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df27c033d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df27478a000 00000100:00100000:2.0:1790772169.383620:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:11593:x1877760412840448:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 Request processed in 82862us (83184us total) trans 0 rc 0/0 00000004:00080000:0.0:1790772169.383623:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:2.0:1790772169.383639:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 226 00000020:00080000:0.0:1790772169.383662:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1790772169.384361:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1790772169.384535:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27af06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428552064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790772169.384599:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27af04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428552192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790772169.384654:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772169.384717:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772169.384799:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428552064 00000100:00100000:2.0:1790772169.384811:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428552064 00000100:00100000:2.0:1790772169.384865:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428552192 00000100:00100000:2.0:1790772169.384869:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428552192 00000100:00100000:2.0:1790772169.384899:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790772169.384910:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1877760428552064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790772169.384949:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1790772169.384993:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abd03c7, atime: 0x6abd03c8, ctime: 0x6abd03c7, blocks: 0x1 00010000:00010000:2.0:1790772169.385003:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087714edf/0xdf68d9a7d6a90daf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.385024:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1790772169.385029:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772169.385037:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087714edf/0xdf68d9a7d6a90daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.385073:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087714edf/0xdf68d9a7d6a90daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.385084:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087714edf/0xdf68d9a7d6a90daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.385093:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087714edf/0xdf68d9a7d6a90daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.385129:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772169.386114:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772169.386128:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087714edf/0xdf68d9a7d6a90daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.386142:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aae00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772169.386147:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087714edf/0xdf68d9a7d6a90daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.386158:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087714edf/0xdf68d9a7d6a90daf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.386177:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087714edf/0xdf68d9a7d6a90daf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.386184:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087714edf/0xdf68d9a7d6a90daf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.386208:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772169.386210:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772169.386212:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772169.386386:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428552064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1473us (1729us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790772169.386397:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790772169.386437:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790772169.386448:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3296:x1877760428552192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790772169.386476:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1790772169.386499:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.386522:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90b71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb9 expref: 12 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.386531:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790772169.386535:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772169.386540:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.386632:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90b71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb9 expref: 12 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.386660:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90b71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb9 expref: 12 pid: 8509 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.386678:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fa04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1877760428552320:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772169.386779:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b82480 going to sleep for 11 seconds 00000004:00080000:1.0:1790772169.387840:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df27af06680/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790772169.387855:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27af06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428552064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790772169.389424:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.389586:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412840576 00000100:00100000:0.0:1790772169.389603:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412840576 00000100:00100000:0.0:1790772169.389653:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:0.0:1790772169.389663:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24319ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+13:2348:x1877760412840576:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790772169.393151:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.393185:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412840704 00000100:00100000:2.0:1790772169.393194:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412840704 00010000:00010000:2.0:1790772169.393237:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90b71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb9 expref: 14 pid: 8509 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.393274:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 83 00000100:00100000:2.0:1790772169.393283:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:2347:x1877760412840704:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772169.393296:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772169.393301:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90b71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb9 expref: 14 pid: 8509 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.393314:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90b71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb9 expref: 14 pid: 8509 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.393337:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772169.393356:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790772169.393362:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.393371:0:5808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.393389:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772169.393442:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+14:2347:x1877760412840704:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 160us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772169.393450:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 83 00010000:00010000:3.0:1790772169.394633:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005c17248/0xdf68d9a7d6a90b71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226cb9 expref: 13 pid: 8509 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.394652:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fa04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1877760428552320:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772169.394674:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.394685:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.394693:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.394705:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.394713:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.394738:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790772169.395622:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3296:x1877760428552192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9174us (10902us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790772169.395632:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1790772169.395916:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772169.395925:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.395935:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab600 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772169.395940:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.395950:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.395970:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.395976:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db42e81a/0xdf68d9a7d6a90db6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.396009:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772169.396010:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772169.396012:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790772169.398370:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df27af04e00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1790772169.398394:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27af04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428552192:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790772169.470727:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24319ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+12:2348:x1877760412840576:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 Request processed in 81052us (81298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772169.470745:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 67 00000001:00080000:3.0:1790772169.470848:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1790772169.470879:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:2.0:1790772169.475262:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.475419:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412840960 00000100:00100000:0.0:1790772169.475433:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412840960 00000100:00100000:0.0:1790772169.475510:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 227 00000100:00100000:0.0:1790772169.475521:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:11593:x1877760412840960:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790772169.475655:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772169.475691:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aba00/0xdf68d9a7d6a90d9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d4c expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.475715:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043000) 00010000:00010000:0.0:1790772169.475721:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790772169.475762:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.475778:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.475813:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790772169.476619:0:6701:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006cee8f93 reply state 000000002a17304c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.476634:0:6701:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772169.476787:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:11593:x1877760412840960:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1264us (1535us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1790772169.476795:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 227 00010000:00010000:1.0:1790772169.480952:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.480998:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.481008:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.481015:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772169.481022:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.481032:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.481051:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043000) 00010000:00010000:1.0:1790772169.481055:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772169.481061:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.481067:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030a00/0xdf68d9a7d6a90dbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.485021:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.485117:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412841088 00000100:00100000:0.0:1790772169.485130:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412841088 00000100:00100000:0.0:1790772169.485328:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:0.0:1790772169.485341:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2348:x1877760412841088:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790772169.485687:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790772169.485692:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790772168 00002000:00010000:0.0:1790772169.485694:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790772168 00002000:00010000:0.0:1790772169.485697:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790772168 -> 1790772168 00002000:00010000:0.0:1790772169.485699:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790772169.485787:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412841088:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 449us (781us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1790772169.485796:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:0.0:1790772169.492439:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.495335:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412841344 00000100:00100000:2.0:1790772169.495355:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412841344 00000100:00100000:2.0:1790772169.495519:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 228 00000100:00100000:2.0:1790772169.495531:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27af07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:11593:x1877760412841344:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790772169.495659:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.495680:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d3e expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.495693:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.495751:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d3e expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.495768:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d3e expref: 21 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.495784:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428552448:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772169.495930:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b82300 going to sleep for 11 seconds 00000100:00100000:2.0:1790772169.499226:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772169.499339:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412841472 00000100:00100000:1.0:1790772169.499351:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412841472 00010000:00010000:1.0:1790772169.499403:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d3e expref: 22 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772169.499452:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:1.0:1790772169.499463:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:2347:x1877760412841472:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772169.499481:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772169.499506:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d3e expref: 22 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.499521:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d3e expref: 22 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.499586:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043000) 00010000:00010000:1.0:1790772169.499602:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.499613:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.499622:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772169.499644:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772169.499701:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:2347:x1877760412841472:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 240us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772169.499719:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 84 00010000:00010000:3.0:1790772169.509138:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a90d7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d3e expref: 21 pid: 5825 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.509187:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877760428552448:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772169.509230:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.509242:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.509248:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.509287:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.509295:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.509303:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.509310:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772169.509314:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.509321:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.509340:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043000) 00010000:00010000:3.0:1790772169.509343:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790772169.509371:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.509377:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab600/0xdf68d9a7d6a90dc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.509491:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27af07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:11593:x1877760412841344:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 Request processed in 13961us (17066us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790772169.509502:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 228 00000100:00100000:2.0:1790772169.512980:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772169.513118:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412841600 00000100:00100000:3.0:1790772169.513131:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412841600 00000100:00100000:3.0:1790772169.513218:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:3.0:1790772169.513230:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2350:x1877760412841600:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790772169.513288:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.513313:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.513323:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772169.513328:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772169.513335:0:6677:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.513377:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.513393:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 8 pid: 6679 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.513427:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1877760428552576:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772169.513777:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772169.518792:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1877760428552576:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772169.518836:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.519292:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.519909:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412841728 00000100:00100000:0.0:1790772169.519922:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412841728 00010000:00010000:0.0:1790772169.519973:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 9 pid: 6679 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.520061:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:0.0:1790772169.520070:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+9:2348:x1877760412841728:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772169.520090:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772169.520116:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 9 pid: 6679 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.520131:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 9 pid: 6679 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.520159:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fa6f755/0xdf68d9a7d6a90da8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d5a expref: 9 pid: 6679 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.520180:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772169.520185:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790772169.520191:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.520203:0:5808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.520247:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772169.520326:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412841728:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 255us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.520334:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 85 00010000:00010000:3.0:1790772169.520580:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.520602:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.520632:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.520641:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.520661:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.520669:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326a00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772169.520673:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.520695:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.520709:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.520717:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a90dcb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772169.520777:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2350:x1877760412841600:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 Request processed in 7549us (7810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772169.520791:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:2.0:1790772169.526949:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.527129:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412841984 00000100:00100000:0.0:1790772169.527142:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412841984 00000100:00100000:0.0:1790772169.527219:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 229 00000100:00100000:0.0:1790772169.527346:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:11593:x1877760412841984:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790772169.527450:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90dd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.527473:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.527486:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.527797:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.527809:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90d8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d45 expref: 21 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.527828:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.527872:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90d8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d45 expref: 21 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.527889:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90d8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d45 expref: 21 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.527906:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877760428552704:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772169.528005:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142accd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772169.531602:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772169.531858:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877760428552704:192.168.206.27@tcp:104: 00010000:00010000:1.0:1790772169.531894:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.532024:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412842112 00000100:00100000:0.0:1790772169.532046:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412842112 00010000:00010000:0.0:1790772169.532091:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90d8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d45 expref: 22 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.532135:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:0.0:1790772169.532146:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:2347:x1877760412842112:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772169.532164:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772169.532172:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90d8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d45 expref: 22 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.532184:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90d8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d45 expref: 22 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.532208:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90d8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d45 expref: 22 pid: 6701 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.532234:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043000) 00010000:00010000:0.0:1790772169.532240:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.532251:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.532259:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.532285:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772169.532351:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:2347:x1877760412842112:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 206us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.532375:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 86 00010000:00010000:3.0:1790772169.532822:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.532831:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772169.537175:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1790772169.537533:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1790772169.537637:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1790772169.538184:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5825:1877760428552832:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790772169.538344:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772169.538394:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142accc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790772169.538574:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428552832 00000100:00100000:3.0:1790772169.538585:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428552832 00000100:00100000:3.0:1790772169.538782:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772169.538794:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1877760428552832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790772169.538907:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1877760428552832:12345-0@lo:1000:mdt00_002.0 Request processed in 115us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772169.538915:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790772169.539023:0:5825:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1790772169.539030:0:5825:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1790772169.539314:0:5825:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8df27af04e00 x1877760428552192/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790772185 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772169.539329:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5825:1877760428552832:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1790772169.541458:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1790772169.541633:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5825:1877760428552960:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790772169.542312:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772169.542361:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2413773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772169.546388:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428552960 00000100:00100000:1.0:1790772169.546407:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428552960 00000100:00100000:1.0:1790772169.546493:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772169.546504:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5825:x1877760428552960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790772169.547819:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5825:x1877760428552960:12345-0@lo:1000:mdt00_002.0 Request processed in 1306us (5499us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1790772169.547851:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790772169.547898:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5825:1877760428552960:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1790772169.547961:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.547974:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.547983:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.547990:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772169.548003:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548012:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548030:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043000) 00010000:00010000:0.0:1790772169.548033:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772169.548212:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548220:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90dd9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548333:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548341:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548348:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548353:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327600 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772169.548357:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548363:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548372:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772169.548374:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772169.548389:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90d23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d29 expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548403:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90d23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d29 expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548413:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90d23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d29 expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.548461:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90d23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d29 expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.548477:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f377b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877760428553088:192.168.206.27@tcp:105: 00000100:00100000:0.0:1790772169.549581:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142accd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772169.565168:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f377b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877760428553088:192.168.206.27@tcp:105: 00010000:00010000:0.0:1790772169.565213:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565236:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327600/0xdf68d9a7d6a90d1c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565281:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90de0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565299:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90de0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565312:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90de0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565346:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90de0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565353:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90de0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565360:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90de0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565367:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772169.565372:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90de0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565380:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90de0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565394:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772169.565398:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772169.565402:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90de0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565408:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031e00/0xdf68d9a7d6a90de0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565419:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565426:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90dd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565431:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565447:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772169.565450:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565456:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90dd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565464:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772169.565467:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790772169.565470:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90dd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.565475:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a90dd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.565851:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:11593:x1877760412841984:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 38505us (39202us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1790772169.565864:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 229 00000020:00080000:0.0:1790772169.565872:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1790772169.567022:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000040:00080000:2.0:1790772169.568044:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772169.568053:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772169.568956:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1790772169.568970:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790772169.573460:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412842240 00000100:00100000:0.0:1790772169.573480:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412842240 00000100:00100000:0.0:1790772169.573581:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:0.0:1790772169.573606:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:11592:x1877760412842240:12345-192.168.206.27@tcp:49:lfs.0 00000100:00100000:0.0:1790772169.573781:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:11592:x1877760412842240:12345-192.168.206.27@tcp:49:lfs.0 Request processed in 190us (6765us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.573790:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:3.0:1790772169.578151:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.578241:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412842496 00000100:00100000:0.0:1790772169.578254:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412842496 00000100:00100000:0.0:1790772169.578343:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:0.0:1790772169.578354:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25db8d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+24:11593:x1877760412842496:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790772169.579218:0:5827:0:(mdd_object.c:4189:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790772169.579340:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1790772169.579394:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.579413:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.579425:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.579434:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.579440:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.579448:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.579469:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790772169.579646:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25db8d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:11593:x1877760412842496:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 1290us (1505us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1790772169.579657:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 62 00000020:00080000:0.0:1790772169.579664:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790772169.580058:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772169.580067:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.580077:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031600 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772169.580082:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.580092:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.580108:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df254043700) 00010000:00010000:2.0:1790772169.580111:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790772169.580116:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.580122:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031600/0xdf68d9a7d6a90de7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.580147:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772169.580149:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772169.580150:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772169.586720:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.586824:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412842752 00000100:00100000:0.0:1790772169.586838:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412842752 00000100:00100000:0.0:1790772169.586910:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 230 00000100:00100000:0.0:1790772169.586921:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:11592:x1877760412842752:12345-192.168.206.27@tcp:58:lfs.0 00000040:00080000:0.0:1790772169.587391:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1790772169.587508:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:11592:x1877760412842752:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 589us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.587518:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 230 00000100:00100000:1.0:1790772169.624330:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772169.625840:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412842880 00000100:00100000:2.0:1790772169.625879:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412842880 00000100:00100000:2.0:1790772169.625973:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 231 00000100:00100000:2.0:1790772169.625985:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+26:11595:x1877760412842880:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772169.626011:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772169.626046:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90dee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d61 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.626126:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90df5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.626144:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.626156:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.626173:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.626887:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.626906:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.627970:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.627991:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d22 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.628002:0:6701:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.628124:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d22 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772169.628145:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d22 expref: 27 pid: 5824 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772169.628162:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428553216:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772169.628462:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b82b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790772169.646439:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1877760428553216:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772169.646478:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772169.652852:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.653148:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412843136 00000100:00100000:0.0:1790772169.653161:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412843136 00000100:00100000:0.0:1790772169.653234:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:0.0:1790772169.653246:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:5587:x1877760412843136:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790772169.653613:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:5587:x1877760412843136:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 368us (772us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1790772169.653622:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:1.0:1790772169.664941:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772169.665196:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412843264 00000100:00100000:0.0:1790772169.665214:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412843264 00010000:00010000:0.0:1790772169.665266:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d22 expref: 29 pid: 5824 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772169.665317:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 87 00000100:00100000:0.0:1790772169.665327:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:2347:x1877760412843264:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772169.665347:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772169.665355:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d22 expref: 29 pid: 5824 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.665369:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d22 expref: 29 pid: 5824 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.665396:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa200/0xdf68d9a7d6a90d0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d22 expref: 29 pid: 5824 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.665435:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772169.665441:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.665452:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.665461:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772169.665505:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772169.665630:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:2347:x1877760412843264:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 303us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.665639:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 87 00010000:00010000:3.0:1790772169.666191:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666202:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772169.666255:0:6701:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790772169.666260:0:6701:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772169.666282:0:6701:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666297:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666308:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666316:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90df5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666324:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90df5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666330:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772169.666336:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90df5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666344:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90df5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666372:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:3.0:1790772169.666375:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772169.666380:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90df5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666387:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa800/0xdf68d9a7d6a90df5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666402:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666407:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666413:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666419:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772169.666421:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666427:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666435:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8df25a490f00) 00010000:00010000:3.0:1790772169.666437:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772169.666441:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90dfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666446:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666505:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aae00/0xdf68d9a7d6a90dee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d61 expref: 28 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666519:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d61 expref: 27 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772169.666527:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:3.0:1790772169.666529:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790772169.666531:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9abe00, rc 0) 00000100:00100000:0.0:1790772169.669265:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:11595:x1877760412842880:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 43265us (44932us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772169.669281:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 231 00010000:00010000:2.0:1790772169.759833:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790772170.507734:0:12488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790772170.507744:0:12488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772170.507798:0:12488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:1.0:1790772170.507805:0:12488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790772170.592818:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790772170.592826:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772170.592869:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:2.0:1790772170.592875:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790772170.592982:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428553344:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790772170.593297:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df142b829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772170.597174:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1877760428553344:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790772170.598386:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772170.598440:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412843392 00000100:00100000:0.0:1790772170.598448:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412843392 00000100:00100000:0.0:1790772170.598514:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 232 00000100:00100000:0.0:1790772170.598525:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:11607:x1877760412843392:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790772170.598600:0:5823:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790772170.598694:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:11607:x1877760412843392:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 171us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772170.598703:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 232 00000100:00080000:3.0:1790772170.598767:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772170.610157:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772170.610567:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412843648 00000100:00100000:0.0:1790772170.610576:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412843648 00000100:00100000:0.0:1790772170.610635:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 233 00000100:00100000:0.0:1790772170.610656:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+27:11607:x1877760412843648:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772170.610676:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772170.610694:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a90e0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d68 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772170.610798:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772170.610813:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772170.610827:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772170.610839:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790772170.610971:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a90e0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d68 expref: 30 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772170.610989:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d68 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772170.610998:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772170.611001:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772170.611005:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030600, rc 0) 00000100:00100000:0.0:1790772170.611058:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:11607:x1877760412843648:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 415us (907us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1790772170.611088:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 233 00000100:00100000:2.0:1790772170.616032:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772170.616164:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412843776 00000100:00100000:1.0:1790772170.616173:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412843776 00000100:00100000:1.0:1790772170.616237:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:1.0:1790772170.616247:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246097850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:2347:x1877760412843776:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772170.616263:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772170.616285:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030600/0xdf68d9a7d6a90e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d68 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772170.616303:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:1.0:1790772170.616308:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772170.616363:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246097850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:2347:x1877760412843776:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 118us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772170.616370:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:3.0:1790772170.619244:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772170.619330:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412844032 00000100:00100000:2.0:1790772170.619339:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412844032 00000100:00100000:2.0:1790772170.619387:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 234 00000100:00100000:2.0:1790772170.619397:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+28:11607:x1877760412844032:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790772170.619469:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90e1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772170.619492:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772170.619503:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772170.619931:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772170.619941:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90e1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772170.619948:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772170.619954:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772170.619959:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772170.619966:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90e1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772170.619977:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:2.0:1790772170.619980:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790772170.619985:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90e1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772170.619990:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abc00/0xdf68d9a7d6a90e1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772170.620180:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:11607:x1877760412844032:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 782us (940us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1790772170.620194:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 234 00000100:00100000:2.0:1790772170.624018:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000040:00080000:3.0:1790772170.624047:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790772170.624051:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1790772170.624822:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412844288 00000100:00100000:1.0:1790772170.624833:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412844288 00000100:00100000:1.0:1790772170.624896:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:1.0:1790772170.624905:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+29:11607:x1877760412844288:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1790772170.624952:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:3.0:1790772170.624960:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790772170.625101:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:11607:x1877760412844288:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 197us (1088us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1790772170.625114:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 64 00010000:00010000:2.0:1790772170.783807:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790772171.679818:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790772171.679827:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790772171.680237:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790772171.680347:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790772171.807757:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772172.314674:0:12539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790772172.314684:0:12539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790772172.315324:0:12539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790772172.315331:0:12539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1790772172.320482:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1790772172.320499:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1790772172.320507:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:1.0:1790772172.485038:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772172.485098:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412844544 00000100:00100000:1.0:1790772172.485106:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412844544 00000100:00100000:1.0:1790772172.485159:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 235 00000100:00100000:1.0:1790772172.485167:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+30:11628:x1877760412844544:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772172.485188:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772172.485205:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90e26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772172.485283:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90e2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772172.485296:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90e2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772172.485307:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90e2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772172.485316:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790772172.485413:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a90e26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d6f expref: 33 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772172.485428:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90e2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d6f expref: 32 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772172.485437:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:1.0:1790772172.485440:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790772172.485449:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9800, rc 0) 00000100:00100000:1.0:1790772172.485496:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:11628:x1877760412844544:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 330us (466us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1790772172.485503:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 235 00000100:00080000:3.0:1790772172.486980:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772172.497478:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772172.498502:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412844672 00000100:00100000:3.0:1790772172.498860:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412844672 00000100:00100000:3.0:1790772172.498915:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 236 00000100:00100000:3.0:1790772172.498932:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:11628:x1877760412844672:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:3.0:1790772172.498993:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326a00/0xdf68d9a7d6a90e3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772172.499010:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326a00/0xdf68d9a7d6a90e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772172.499020:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326a00/0xdf68d9a7d6a90e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772172.499043:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326a00/0xdf68d9a7d6a90e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772172.499050:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326a00/0xdf68d9a7d6a90e3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772172.499056:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326a00/0xdf68d9a7d6a90e3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772172.499061:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772172.499066:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326a00/0xdf68d9a7d6a90e3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772172.499073:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326a00/0xdf68d9a7d6a90e3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772172.499083:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:3.0:1790772172.499087:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790772172.499091:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326a00/0xdf68d9a7d6a90e3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772172.499098:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326a00/0xdf68d9a7d6a90e3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772172.499757:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:11628:x1877760412844672:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 823us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772172.499766:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 236 00000100:00100000:1.0:1790772172.634771:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772172.635155:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412844800 00000100:00100000:0.0:1790772172.635164:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412844800 00000100:00100000:0.0:1790772172.635269:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:0.0:1790772172.635279:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2349:x1877760412844800:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:0.0:1790772172.635296:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772172.635315:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023674eb5/0xdf68d9a7d6a90e42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d76 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790772172.635339:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abd03c8, atime: 0x6abd03c8, ctime: 0x6abd03c8, blocks: 0xb 00010000:00010000:0.0:1790772172.635358:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1790772172.635362:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772172.635370:0:6679:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023674eb5/0xdf68d9a7d6a90e42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d76 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772172.635388:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023674eb5/0xdf68d9a7d6a90e42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d76 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772172.635401:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030e00, rc 0) 00000100:00100000:0.0:1790772172.635456:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2349:x1877760412844800:12345-192.168.206.27@tcp:101:cat.0 Request processed in 179us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772172.635479:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00080000:3.0:1790772172.647769:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790772172.647908:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772172.647987:0:6683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412844928 00000100:00100000:2.0:1790772172.647996:0:6683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412844928 00002000:00100000:2.0:1790772172.648040:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8df27ab65f80 x1877760412844928/t0(0) o3->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:518/0 lens 488/0 e 0 to 0 dl 1790772183 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790772172.648051:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27ab65f80 with x1877760412844928 ext(0->4095) 00002000:00010000:2.0:1790772172.648056:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27ab65f80 00000100:00100000:2.0:1790772172.648087:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:2.0:1790772172.648095:0:6683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412844928:12345-192.168.206.27@tcp:3:cat.0 00000100:00100000:2.0:1790772172.648283:0:6683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412844928:12345-192.168.206.27@tcp:3:cat.0 Request processed in 187us (378us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790772172.648291:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00002000:00100000:2.0:1790772172.648298:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8df27ab65f80 x1877760412844928/t0(0) o3->9271f5fd-fa87-4f6b-a8bf-0936e195e8be@192.168.206.27@tcp:518/0 lens 488/4536 e 0 to 0 dl 1790772183 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790772172.648306:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27ab65f80 with x1877760412844928 ext(0->4095) 00002000:00010000:2.0:1790772172.648310:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27ab65f80 00010000:00010000:2.0:1790772172.832944:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772173.280111:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428553600:0@lo:400:kworker.0 00000100:00100000:3.0:1790772173.280176:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772173.280231:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772173.280237:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428553472:0@lo:400:kworker.0 00000100:00100000:3.0:1790772173.280267:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772173.280352:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428553600 00000100:00100000:1.0:1790772173.280359:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428553600 00000100:00100000:1.0:1790772173.280409:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790772173.280418:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428553600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772173.280471:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877760428553600:12345-0@lo:400:kworker.0 Request processed in 54us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772173.280477:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790772173.280498:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428553472 00000100:00100000:1.0:1790772173.280501:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428553472 00000100:00100000:1.0:1790772173.280522:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1790772173.280528:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428553472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772173.280592:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428553472:12345-0@lo:400:kworker.0 Request processed in 63us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772173.280599:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1790772173.280649:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428553472:0@lo:400:kworker.0 00000100:00100000:1.0:1790772173.280799:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877760428553600:0@lo:400:kworker.0 00000100:00100000:2.0:1790772173.281068:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428553856:0@lo:400:kworker.0 00000100:00100000:2.0:1790772173.281147:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772173.281187:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790772173.281194:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428553728:0@lo:400:kworker.0 00000100:00100000:2.0:1790772173.281254:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772173.281409:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428553728 00000100:00100000:3.0:1790772173.281417:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428553728 00000100:00100000:3.0:1790772173.281466:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790772173.281475:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428553728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772173.281544:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428553728:12345-0@lo:400:kworker.0 Request processed in 69us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772173.281605:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790772173.281629:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428553728:0@lo:400:kworker.0 00000100:00100000:1.0:1790772173.281842:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428553856 00000100:00100000:1.0:1790772173.281849:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428553856 00000100:00100000:1.0:1790772173.281884:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790772173.281893:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428553856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772173.281961:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428553856:12345-0@lo:400:kworker.0 Request processed in 71us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772173.281969:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790772173.281997:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428553984:0@lo:400:kworker.0 00000100:00100000:1.0:1790772173.282031:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772173.282058:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772173.282065:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27b282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428554112:0@lo:400:kworker.0 00000100:00100000:1.0:1790772173.282105:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772173.282133:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428554112 00000100:00100000:1.0:1790772173.282137:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428554112 00000100:00100000:1.0:1790772173.282176:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790772173.282184:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27414cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1877760428554112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772173.282226:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27414cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1877760428554112:12345-0@lo:400:kworker.0 Request processed in 44us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772173.282233:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790772173.282378:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1790772173.282384:0:3296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1790772173.282402:0:3296:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df27af06680, transno 4294967310 00000100:00100000:1.0:1790772173.282415:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428553856:0@lo:400:kworker.0 00000100:00100000:3.0:1790772173.283346:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428553984 00000100:00100000:3.0:1790772173.283354:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428553984 00000100:00100000:3.0:1790772173.283845:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790772173.283856:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428553984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772173.283916:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428553984:12345-0@lo:400:kworker.0 Request processed in 63us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772173.283922:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:3.0:1790772173.283951:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772173.283956:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772173.283959:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772173.284008:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27b282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428554112:0@lo:400:kworker.0 00000100:00100000:0.0:1790772173.284027:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428553984:0@lo:400:kworker.0 00000100:00100000:0.0:1790772173.284063:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428554240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772173.284096:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772173.284251:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428554240 00000100:00100000:3.0:1790772173.284256:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428554240 00000100:00100000:3.0:1790772173.284292:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790772173.284298:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428554240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772173.284324:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772173.284359:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428554240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772173.284365:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790772173.284395:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428554240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772173.352782:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772173.352827:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772173.352857:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772173.352877:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772173.352914:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772173.352944:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412845312 00000100:00100000:2.0:1790772173.352953:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412845312 00000100:00100000:2.0:1790772173.353002:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412845440 00000100:00100000:2.0:1790772173.353005:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412845440 00000100:00100000:2.0:1790772173.353025:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:2.0:1790772173.353033:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412845312:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772173.353095:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2348:x1877760412845312:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 62us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772173.353103:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:2.0:1790772173.353119:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:2.0:1790772173.353125:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412845440:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772173.353149:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+8:2348:x1877760412845440:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 24us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772173.353155:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:2.0:1790772173.353171:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412845568 00000100:00100000:2.0:1790772173.353175:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412845568 00000100:00100000:2.0:1790772173.353199:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412845184 00000100:00100000:2.0:1790772173.353202:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412845184 00000100:00100000:2.0:1790772173.353220:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 156 00000100:00100000:2.0:1790772173.353238:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412845568:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772173.353265:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2348:x1877760412845568:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772173.353271:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 156 00000100:00100000:2.0:1790772173.353284:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 157 00000100:00100000:2.0:1790772173.353290:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27b282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:2348:x1877760412845184:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772173.353312:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27b282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+32:2348:x1877760412845184:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 22us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772173.353318:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 157 00000100:00080000:2.0:1790772173.353338:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790772173.353342:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772173.353534:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412845056 00000100:00100000:3.0:1790772173.353539:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412845056 00000100:00100000:3.0:1790772173.353608:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 295 00000100:00100000:3.0:1790772173.353616:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412845056:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772173.353648:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2348:x1877760412845056:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 33us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772173.353655:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 295 00000004:00080000:1.0:1790772173.791856:0:8045:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339936302821ns, next at 340936299582ns, rc = 0 00000100:00100000:3.0:1790772173.791946:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772173.791972:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428554368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772173.792054:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772173.792198:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428554368 00000100:00100000:2.0:1790772173.792209:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428554368 00000100:00100000:2.0:1790772173.792265:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790772173.792275:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428554368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772173.792323:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772173.792382:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428554368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772173.792390:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790772173.792754:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ab67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428554368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772173.863766:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790772174.354144:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:0.0:1790772174.354183:0:5845:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df142accc00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1790772174.354189:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df2466af300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df142acc300 00000020:00080000:0.0:1790772174.354193:0:5845:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df2466af000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df27457a400 00000020:00080000:0.0:1790772174.354221:0:5845:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:0.0:1790772174.354231:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:0.0:1790772174.354255:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1790772174.354323:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1790772174.354602:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1790772174.354851:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772174.354879:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428554496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790772174.354969:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772174.355145:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428554496 00000100:00100000:2.0:1790772174.355155:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428554496 00000100:00100000:2.0:1790772174.355213:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790772174.355222:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1877760428554496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1790772174.355403:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790772174.355406:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1790772168 -> 1790772168 00002000:00010000:2.0:1790772174.355423:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1790772168 -> 1790772168 00002000:00010000:2.0:1790772174.355426:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790772168 -> 1790772168 00002000:00010000:2.0:1790772174.355428:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790772174.355486:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3294:x1877760428554496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 264us (517us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1790772174.355494:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:2.0:1790772174.355546:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df26fad4000/2, rc 0, transno 4294967324 00000100:00100000:2.0:1790772174.355590:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428554496:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1790772174.887190:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790772174.927721:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1790772174.927763:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1790772174.927942:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:2.0:1790772175.903969:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772176.928855:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772177.892485:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772177.892761:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412845696 00000100:00100000:0.0:1790772177.892770:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412845696 00000100:00100000:0.0:1790772177.892850:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 237 00000100:00100000:0.0:1790772177.892862:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:11273:x1877760412845696:12345-192.168.206.27@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790772177.892962:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:11273:x1877760412845696:12345-192.168.206.27@tcp:60:lhsmtool_posix.0 Request processed in 103us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772177.892970:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 237 00000100:00080000:3.0:1790772177.893108:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772177.895927:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772177.897220:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412845952 00000100:00100000:0.0:1790772177.897237:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412845952 00000100:00100000:1.0:1790772177.897603:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00100000:1.0:1790772177.897619:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:11273:x1877760412845952:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790772177.898123:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:11273:x1877760412845952:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 506us (2209us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1790772177.898133:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 65 00010000:00010000:2.0:1790772177.953396:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772178.400701:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428554624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772178.400769:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772178.400822:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428554624 00000100:00100000:0.0:1790772178.400829:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428554624 00000100:00100000:0.0:1790772178.400889:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790772178.400899:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428554624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772178.400945:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772178.400989:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428554624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772178.400996:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790772178.401026:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428554624:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772178.401058:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772178.401158:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428554880:0@lo:400:kworker.0 00000100:00100000:1.0:1790772178.401190:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772178.401231:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790772178.401237:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428554752:0@lo:400:kworker.0 00000100:00100000:1.0:1790772178.401265:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772178.401275:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428555008:0@lo:400:kworker.0 00000100:00100000:1.0:1790772178.401284:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428555264:0@lo:400:kworker.0 00000100:00100000:2.0:1790772178.401301:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772178.401301:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772178.401320:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790772178.401325:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428555136:0@lo:400:kworker.0 00000100:00100000:1.0:1790772178.401339:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428554880 00000100:00100000:1.0:1790772178.401343:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428554880 00000100:00100000:2.0:1790772178.401345:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772178.401378:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428555264 00000100:00100000:1.0:1790772178.401379:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428555008 00000100:00100000:2.0:1790772178.401382:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428555264 00000100:00100000:1.0:1790772178.401382:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428555008 00000100:00100000:1.0:1790772178.401397:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428555136 00000100:00100000:1.0:1790772178.401399:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428555136 00000100:00100000:2.0:1790772178.401409:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790772178.401410:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790772178.401415:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428555264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772178.401415:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ab67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428554880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772178.401450:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ab67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428554880:12345-0@lo:400:kworker.0 Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772178.401456:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790772178.401470:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790772178.401476:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428555008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772178.401479:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790772178.401491:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428555136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772178.401518:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428555136:12345-0@lo:400:kworker.0 Request processed in 28us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772178.401518:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428555008:12345-0@lo:400:kworker.0 Request processed in 42us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772178.401524:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1790772178.401590:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772178.401594:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772178.401647:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428554752 00000100:00100000:3.0:1790772178.401651:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428554752 00000100:00100000:3.0:1790772178.401675:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1790772178.401681:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428554752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772178.401835:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790772178.401880:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428555136:0@lo:400:kworker.0 00000100:00100000:1.0:1790772178.401890:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428555008:0@lo:400:kworker.0 00000100:00100000:2.0:1790772178.403048:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428555264:12345-0@lo:400:kworker.0 Request processed in 1629us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772178.403072:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790772178.403402:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1790772178.403409:0:3296:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df27af04e00, transno 4294967321 00000004:00080000:0.0:1790772178.403425:0:3296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967324 00000004:00080000:0.0:1790772178.403441:0:3296:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df26fad4000, transno 4294967324 00000100:00100000:0.0:1790772178.403448:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428555264:0@lo:400:kworker.0 00000100:00100000:0.0:1790772178.403464:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428554880:0@lo:400:kworker.0 00000100:00100000:3.0:1790772178.404228:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3296:x1877760428554752:12345-0@lo:400:kworker.0 Request processed in 2542us (2958us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772178.404237:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1790772178.404416:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428554752:0@lo:400:kworker.0 00000100:00100000:2.0:1790772178.471963:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772178.472007:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772178.472037:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772178.472074:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772178.472102:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412846464 00000100:00100000:2.0:1790772178.472110:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412846464 00000100:00100000:2.0:1790772178.472163:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 161 00000100:00100000:2.0:1790772178.472172:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412846464:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772178.472236:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:2347:x1877760412846464:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 65us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772178.472243:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 161 00000100:00080000:2.0:1790772178.472263:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772178.472324:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412846336 00000100:00100000:0.0:1790772178.472328:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412846336 00000100:00100000:0.0:1790772178.472370:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412846208 00000100:00100000:0.0:1790772178.472372:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412846208 00000100:00100000:0.0:1790772178.472389:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 81 00000100:00100000:0.0:1790772178.472395:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412846336:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772178.472425:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2347:x1877760412846336:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772178.472431:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 81 00000100:00100000:0.0:1790772178.472444:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:0.0:1790772178.472450:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412846208:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772178.472472:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2347:x1877760412846208:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 23us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772178.472491:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:1.0:1790772178.473001:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412846080 00000100:00100000:1.0:1790772178.473007:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412846080 00000100:00100000:1.0:1790772178.473041:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 297 00000100:00100000:1.0:1790772178.473048:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2347:x1877760412846080:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772178.473089:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2347:x1877760412846080:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 41us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772178.473095:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 297 00000100:00080000:2.0:1790772178.473487:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790772178.473491:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790772178.912207:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428555392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772178.912275:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772178.912379:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428555392 00000100:00100000:2.0:1790772178.912387:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428555392 00000100:00100000:2.0:1790772178.912428:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790772178.912437:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428555392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772178.912474:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772178.912520:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428555392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772178.912527:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790772178.912683:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428555392:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772178.976139:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790772179.499680:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1790772179.499702:0:5845:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1790772179.499727:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1790772179.499739:0:5856:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1790772179.999791:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772180.024377:0:12740:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:42:57 (1790772177) 00010000:00010000:0.0:1790772181.025416:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790772181.920614:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790772181.920627:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772181.925189:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1790772181.925206:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790772182.056496:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772182.504672:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772182.504893:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412846592 00000100:00100000:3.0:1790772182.504906:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412846592 00000100:00100000:3.0:1790772182.505138:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 238 00000100:00100000:3.0:1790772182.505154:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+5:12291:x1877760412846592:12345-192.168.206.27@tcp:101:lsof.0 00010000:00010000:3.0:1790772182.505181:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772182.505207:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326600/0xdf68d9a7d6a90e49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d7d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790772182.505758:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790772182.510611:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90e50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772182.510643:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90e50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772182.510684:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90e50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772182.510741:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772182.510747:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772182.510807:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90e50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772182.510851:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241326600/0xdf68d9a7d6a90e49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d7d expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772182.510880:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90e50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d7d expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772182.510890:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25a490700) 00010000:00010000:3.0:1790772182.510893:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772182.510897:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241327800, rc 0) 00000100:00100000:3.0:1790772182.513810:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:12291:x1877760412846592:12345-192.168.206.27@tcp:101:lsof.0 Request processed in 8642us (9132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772182.513826:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 238 00010000:00010000:0.0:1790772183.071804:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772183.519800:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428555520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772183.519811:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428555776:0@lo:400:kworker.0 00000100:00100000:2.0:1790772183.519859:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428555648:0@lo:400:kworker.0 00000100:00100000:3.0:1790772183.520058:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772183.520105:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428556288:0@lo:400:kworker.0 00000100:00100000:3.0:1790772183.520143:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772183.520184:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772183.520190:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428555904:0@lo:400:kworker.0 00000100:00100000:3.0:1790772183.520211:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772183.520280:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428555776 00000100:00100000:3.0:1790772183.520287:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428555776 00000100:00100000:3.0:1790772183.520325:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428555904 00000100:00100000:3.0:1790772183.520328:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428555904 00000100:00100000:3.0:1790772183.520371:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790772183.520379:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428555776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772183.520428:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428555776:12345-0@lo:400:kworker.0 Request processed in 50us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772183.520435:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790772183.520463:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790772183.520469:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428555904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772183.520495:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428555904:12345-0@lo:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772183.520500:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790772183.520543:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428555904:0@lo:400:kworker.0 00000100:00100000:3.0:1790772183.520579:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428555776:0@lo:400:kworker.0 00000100:00080000:3.0:1790772183.520618:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772183.520638:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428556288 00000100:00100000:3.0:1790772183.520641:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428556288 00000100:00100000:3.0:1790772183.520671:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790772183.520678:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428556288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772183.520712:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428556288:12345-0@lo:400:kworker.0 Request processed in 34us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772183.520718:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1790772183.520738:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772183.520753:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428556288:0@lo:400:kworker.0 00000100:00100000:1.0:1790772183.522351:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772183.522575:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428555520 00000100:00100000:3.0:1790772183.522582:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428555520 00000100:00080000:0.0:1790772183.522654:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772183.522882:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772183.522927:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428555520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790772183.522971:0:6680:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772183.528057:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772183.528064:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428556032:0@lo:400:kworker.0 00000100:00100000:2.0:1790772183.528091:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1877760428556160:0@lo:400:kworker.0 00000100:00100000:1.0:1790772183.528112:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772183.528115:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772183.528157:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428556032 00000100:00100000:1.0:1790772183.528164:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428556032 00000100:00100000:1.0:1790772183.528208:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790772183.528217:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1877760428556032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772183.528284:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1877760428556032:12345-0@lo:400:kworker.0 Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772183.528292:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790772183.528334:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428556032:0@lo:400:kworker.0 00000100:00100000:1.0:1790772183.528376:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428556160 00000100:00100000:1.0:1790772183.528380:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428556160 00000100:00100000:1.0:1790772183.528413:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790772183.528420:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877760428556160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772183.528456:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877760428556160:12345-0@lo:400:kworker.0 Request processed in 36us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772183.528462:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790772183.530697:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428555520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7800us (8343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772183.530709:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790772183.530727:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428555648 00000100:00100000:2.0:1790772183.530735:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428555648 00000100:00100000:2.0:1790772183.530777:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1790772183.530784:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1877760428556160:0@lo:400:kworker.0 00000100:00100000:2.0:1790772183.530785:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428555648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772183.530916:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428555648:12345-0@lo:400:kworker.0 Request processed in 131us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772183.530923:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:0.0:1790772183.531042:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772183.531388:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428555520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772183.531460:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428555648:0@lo:400:kworker.0 00000100:00100000:0.0:1790772183.591064:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772183.591108:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772183.591151:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772183.591183:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772183.591232:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772183.591261:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412846976 00000100:00100000:0.0:1790772183.591270:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412846976 00000100:00100000:0.0:1790772183.591319:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412847104 00000100:00100000:0.0:1790772183.591322:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412847104 00000100:00100000:0.0:1790772183.591345:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:0.0:1790772183.591353:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2349:x1877760412846976:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772183.591417:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2349:x1877760412846976:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 64us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772183.591424:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:0.0:1790772183.591455:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:0.0:1790772183.591463:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2349:x1877760412847104:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772183.591505:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2349:x1877760412847104:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 43us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772183.591512:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:0.0:1790772183.591545:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412847232 00000100:00100000:0.0:1790772183.591578:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412847232 00000100:00100000:0.0:1790772183.591602:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412846848 00000100:00100000:0.0:1790772183.591605:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412846848 00000100:00100000:0.0:1790772183.591626:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 165 00000100:00100000:0.0:1790772183.591633:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:2349:x1877760412847232:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772183.591662:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:2349:x1877760412847232:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772183.591668:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 165 00000100:00100000:0.0:1790772183.591681:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 166 00000100:00100000:0.0:1790772183.591687:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:2349:x1877760412846848:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772183.591721:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:2349:x1877760412846848:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 34us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772183.591728:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 166 00000100:00080000:0.0:1790772183.591744:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772183.591748:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772183.591749:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772183.591820:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412846720 00000100:00100000:3.0:1790772183.591824:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412846720 00000100:00100000:3.0:1790772183.591859:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 299 00000100:00100000:3.0:1790772183.591867:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2349:x1877760412846720:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772183.591894:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2349:x1877760412846720:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 28us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772183.591900:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 299 00000100:00100000:0.0:1790772184.036647:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772184.036670:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428556416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772184.036735:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772184.037154:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428556416 00000100:00100000:1.0:1790772184.037162:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428556416 00000100:00100000:1.0:1790772184.037212:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790772184.037222:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428556416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772184.037255:0:6681:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772184.037311:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428556416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772184.037318:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790772184.039745:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428556416:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790772184.095787:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772184.583901:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772184.584266:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412847488 00000100:00100000:3.0:1790772184.584277:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412847488 00000100:00100000:3.0:1790772184.584338:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00100000:3.0:1790772184.584349:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+19:12292:x1877760412847488:12345-192.168.206.27@tcp:35:umount.0 00000100:00100000:3.0:1790772184.584679:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:12292:x1877760412847488:12345-192.168.206.27@tcp:35:umount.0 Request processed in 331us (786us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1790772184.584687:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00100000:3.0:1790772184.590709:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772184.590866:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412847744 00000100:00100000:1.0:1790772184.590876:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412847744 00000100:00100000:1.0:1790772184.590927:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:1.0:1790772184.590936:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+20:12292:x1877760412847744:12345-192.168.206.27@tcp:35:umount.0 00000100:00100000:1.0:1790772184.591434:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:12292:x1877760412847744:12345-192.168.206.27@tcp:35:umount.0 Request processed in 496us (731us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1790772184.591443:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:1.0:1790772184.595997:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772184.596302:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412848000 00000100:00100000:3.0:1790772184.596431:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412848000 00000100:00100000:3.0:1790772184.596534:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:3.0:1790772184.596545:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25db8d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+21:12292:x1877760412848000:12345-192.168.206.27@tcp:35:umount.0 00000100:00100000:3.0:1790772184.596782:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25db8d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:12292:x1877760412848000:12345-192.168.206.27@tcp:35:umount.0 Request processed in 238us (791us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1790772184.596800:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:1.0:1790772184.609645:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772184.609732:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412848256 00000100:00100000:2.0:1790772184.609743:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412848256 00000100:00100000:2.0:1790772184.609800:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:2.0:1790772184.609810:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:12292:x1877760412848256:12345-192.168.206.27@tcp:35:umount.0 00000100:00100000:2.0:1790772184.610129:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:12292:x1877760412848256:12345-192.168.206.27@tcp:35:umount.0 Request processed in 319us (492us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1790772184.610137:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:0.0:1790772184.613843:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772184.613895:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772184.613920:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772184.614019:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412848384 00000100:00100000:2.0:1790772184.614029:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412848384 00000100:00100000:2.0:1790772184.614081:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412848640 00000100:00100000:2.0:1790772184.614084:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412848640 00000100:00100000:2.0:1790772184.614095:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412848512 00000100:00100000:2.0:1790772184.614097:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412848512 00000100:00100000:2.0:1790772184.614112:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:2.0:1790772184.614121:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+15:2347:x1877760412848384:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772184.614145:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772184.614177:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f8d9c00/0xdf68d9a7d6a8fed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22690f expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772184.614198:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772184.614249:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+14:2347:x1877760412848384:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 129us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772184.614256:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:2.0:1790772184.614273:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:2.0:1790772184.614280:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+13:2347:x1877760412848640:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772184.614291:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772184.614301:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9aa000/0xdf68d9a7d6a900ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269da expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772184.614310:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772184.614667:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:2347:x1877760412848640:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 386us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772184.614674:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:2.0:1790772184.614689:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:2.0:1790772184.614695:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:2347:x1877760412848512:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772184.614703:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772184.614712:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240031000/0xdf68d9a7d6a8fe3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2268d7 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772184.614722:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772184.614738:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2347:x1877760412848512:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 44us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772184.614751:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:1.0:1790772184.616931:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772184.617008:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412849024 00000100:00100000:0.0:1790772184.617017:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412849024 00000100:00100000:0.0:1790772184.617065:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 72 00000100:00100000:0.0:1790772184.617073:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+7:2346:x1877760412849024:12345-192.168.206.27@tcp:9:umount.0 00000020:00000080:0.0:1790772184.617099:0:6678:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a90416 00000020:00010000:0.0:1790772184.617105:0:6678:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8df26f773000: total 0 00000100:00080000:0.0:1790772184.617109:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8df26f772000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790772184.617148:0:6678:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1790772184.617672:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2346:x1877760412849024:12345-192.168.206.27@tcp:9:umount.0 Request processed in 598us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772184.617680:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 72 00000020:00010000:2.0:1790772184.618137:0:5811:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8df26f773000: total 0 00010000:00010000:2.0:1790772184.618183:0:5811:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df26f773000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1790772184.618235:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daece798/0xdf68d9a7d6a907b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226baf expref: 4 pid: 8509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772184.618269:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023674eb5/0xdf68d9a7d6a90e42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d76 expref: 3 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772184.618283:0:5811:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df26f773000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1790772184.618294:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772184.618296:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772184.618297:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772184.625738:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772184.626117:0:8509:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412849152 00000100:00100000:1.0:1790772184.626127:0:8509:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412849152 00000100:00100000:1.0:1790772184.626189:0:8509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00100000:1.0:1790772184.626198:0:8509:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+5:2346:x1877760412849152:12345-192.168.206.27@tcp:9:umount.0 00000020:00000080:1.0:1790772184.626225:0:8509:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a901ae 00000100:00080000:1.0:1790772184.626232:0:8509:0:(import.c:65:import_set_state_nolock()) ffff8df141321000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790772184.626269:0:8509:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1790772184.626391:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772184.626727:0:8509:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+2:2346:x1877760412849152:12345-192.168.206.27@tcp:9:umount.0 Request processed in 529us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772184.626736:0:8509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00100000:3.0:1790772184.632280:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772184.632526:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412850176 00000100:00100000:0.0:1790772184.632536:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412850176 00000100:00100000:1.0:1790772184.632796:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 239 00000100:00100000:1.0:1790772184.632808:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+23:2346:x1877760412850176:12345-192.168.206.27@tcp:39:umount.0 00000020:00000080:1.0:1790772184.632840:0:5825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fe4a 00000020:00010000:1.0:1790772184.632855:0:5825:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8df27c041000: total 0 00000100:00080000:1.0:1790772184.632859:0:5825:0:(import.c:65:import_set_state_nolock()) ffff8df273eba800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790772184.632888:0:5825:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1790772184.633243:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9271f5fd-fa87-4f6b-a8bf-0936e195e8be+22:2346:x1877760412850176:12345-192.168.206.27@tcp:39:umount.0 Request processed in 436us (969us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1790772184.633252:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 239 00000020:00010000:0.0:1790772184.634006:0:5811:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8df27c041000: total 0 00010000:00010000:0.0:1790772184.634012:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772184.634055:0:5811:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df27c041000, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1790772184.634086:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772184.634090:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790772184.634098:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9400/0xdf68d9a7d6a90184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226a04 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634121:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772184.634124:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790772184.634128:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a90e2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d6f expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634141:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772184.634152:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772184.634157:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9a00/0xdf68d9a7d6a90693 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b62 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634173:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772184.634175:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772184.634179:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d9e00/0xdf68d9a7d6a9078f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ba1 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634192:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772184.634194:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772184.634198:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9abe00/0xdf68d9a7d6a90e03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d61 expref: 17 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634210:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df251c57700) 00010000:00010000:0.0:1790772184.634213:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772184.634217:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a90130 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269ef expref: 16 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634234:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772184.634237:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790772184.634240:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2e00/0xdf68d9a7d6a90b01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226c9d expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634253:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772184.634256:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790772184.634259:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2414a2a00/0xdf68d9a7d6a90765 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226b9a expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634284:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8df254043a00) 00010000:00010000:0.0:1790772184.634286:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790772184.634290:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9a00/0xdf68d9a7d6a9079d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ba8 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634306:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8df25a490e00) 00010000:00010000:0.0:1790772184.634309:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772184.634386:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031200/0xdf68d9a7d6a90d23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d29 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634407:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8df27c001a00) 00010000:00010000:0.0:1790772184.634410:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790772184.634415:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9e00/0xdf68d9a7d6a90822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bcb expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634429:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25a490700) 00010000:00010000:0.0:1790772184.634432:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772184.634436:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab800/0xdf68d9a7d6a90806 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226bc4 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634449:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772184.634451:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790772184.634455:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8e00/0xdf68d9a7d6a90471 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ad6 expref: 9 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634469:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df254043600) 00010000:00010000:0.0:1790772184.634471:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772184.634483:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f8d8a00/0xdf68d9a7d6a90114 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269e8 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772184.634497:0:5811:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df27c041000, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1790772184.634523:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772184.634525:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772184.634527:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790772185.107331:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:1.0:1790772185.107342:0:7629:0:(genops.c:885:class_export_put()) final put ffff8df26f773000/9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:3.0:1790772185.107429:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df26f773000/9271f5fd-fa87-4f6b-a8bf-0936e195e8be for lustre-OST0001 00000020:00000080:3.0:1790772185.107505:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df26f772000 for lustre-OST0001 00010000:00010000:2.0:1790772185.123248:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772186.146706:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772186.420771:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772186.420817:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772186.420853:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772186.420930:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412850304 00000100:00100000:0.0:1790772186.420940:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412850304 00000100:00100000:0.0:1790772186.420995:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412850560 00000100:00100000:0.0:1790772186.420998:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412850560 00000100:00100000:0.0:1790772186.421012:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412850432 00000100:00100000:0.0:1790772186.421014:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412850432 00000100:00100000:0.0:1790772186.421030:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:0.0:1790772186.421049:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c23a58-79a4-4ff1-a93b-1cfd03211375+12:2348:x1877760412850304:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772186.421065:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772186.421083:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a8ff1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226924 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772186.421100:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772186.421146:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c23a58-79a4-4ff1-a93b-1cfd03211375+11:2348:x1877760412850304:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 97us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772186.421153:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:0.0:1790772186.421171:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:0.0:1790772186.421177:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c23a58-79a4-4ff1-a93b-1cfd03211375+10:2348:x1877760412850560:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772186.421184:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772186.421205:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a900e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f2269d3 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772186.421227:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772186.421245:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c23a58-79a4-4ff1-a93b-1cfd03211375+9:2348:x1877760412850560:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 68us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772186.421251:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:0.0:1790772186.421265:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:0.0:1790772186.421271:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c23a58-79a4-4ff1-a93b-1cfd03211375+8:2348:x1877760412850432:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772186.421279:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772186.421287:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a3000/0xdf68d9a7d6a8ff23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f22694e expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772186.421295:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772186.421312:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36c23a58-79a4-4ff1-a93b-1cfd03211375+7:2348:x1877760412850432:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 41us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772186.421318:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:3.0:1790772186.431020:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772186.432157:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412850816 00000100:00100000:1.0:1790772186.432174:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412850816 00000100:00100000:1.0:1790772186.432322:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 240 00000100:00100000:1.0:1790772186.432334:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+6:2346:x1877760412850816:12345-192.168.206.27@tcp:39:umount.0 00000020:00000080:1.0:1790772186.432456:0:5823:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8ff31 00000020:00010000:1.0:1790772186.432465:0:5823:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8df248b56800: total 0 00000100:00080000:1.0:1790772186.432471:0:5823:0:(import.c:65:import_set_state_nolock()) ffff8df248b53800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790772186.432700:0:5823:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1790772186.432718:0:5812:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8df248b56800: total 0 00010000:00010000:2.0:1790772186.432914:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df248b56800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790772186.432952:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25a490700) 00010000:00010000:2.0:1790772186.432956:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772186.432967:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241327800/0xdf68d9a7d6a90e50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d7d expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772186.432993:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df248b56800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1790772186.433007:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772186.433010:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772186.433018:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772186.433305:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b4ee020b-4bbb-4a28-b296-bb1d54b5868f+3:2346:x1877760412850816:12345-192.168.206.27@tcp:39:umount.0 Request processed in 970us (2358us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1790772186.433318:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 240 00000100:00080000:0.0:1790772186.433323:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772186.453066:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772186.453246:0:5816:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412851072 00000100:00100000:2.0:1790772186.453260:0:5816:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412851072 00000100:00100000:2.0:1790772186.453322:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 300 00000100:00100000:2.0:1790772186.453332:0:5816:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+7:2346:x1877760412851072:12345-192.168.206.27@tcp:251:umount.0 00000020:00000080:2.0:1790772186.453396:0:5816:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fe27 00000020:00010000:2.0:1790772186.453405:0:5816:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8df27af1f800: total 0 00000100:00080000:2.0:1790772186.453411:0:5816:0:(import.c:65:import_set_state_nolock()) ffff8df27af1a800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790772186.453515:0:5816:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36c23a58-79a4-4ff1-a93b-1cfd03211375+3:2346:x1877760412851072:12345-192.168.206.27@tcp:251:umount.0 Request processed in 183us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772186.453523:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 300 00000020:00010000:0.0:1790772186.453818:0:5811:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8df27af1f800: total 0 00010000:00010000:0.0:1790772186.453824:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772186.453879:0:5811:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df27af1f800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790772186.453918:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f8d9800/0xdf68d9a7d6a8fedd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226916 expref: 2 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772186.453939:0:5811:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df27af1f800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1790772186.453950:0:5811:0:(genops.c:885:class_export_put()) final put ffff8df27af1f800/36c23a58-79a4-4ff1-a93b-1cfd03211375 00010000:00010000:0.0:1790772186.453971:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772186.453973:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772186.453974:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790772186.454077:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27af1f800/36c23a58-79a4-4ff1-a93b-1cfd03211375 for MGS 00000020:00000080:2.0:1790772186.454123:0:2348:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df27af1a800 for MGS 00010000:00010000:3.0:1790772187.167899:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790772187.672674:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:3.0:1790772187.672685:0:6704:0:(genops.c:885:class_export_put()) final put ffff8df27d3b4000/9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:0.0:1790772187.672992:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27d3b4000/9271f5fd-fa87-4f6b-a8bf-0936e195e8be for lustre-OST0000 00000020:00000080:0.0:1790772187.673047:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df141321000 for lustre-OST0000 00010000:00010000:0.0:1790772188.191827:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790772188.443626:0:12940:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790772188.465113:0:12940:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1790772188.465182:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772188.465205:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772188.465224:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772188.465233:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772188.465259:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790772188.465266:0:12940:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790772188.465293:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790772188.465298:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1790772188.465313:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1790772188.465325:0:12940:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1790772188.465326:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772188.465338:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df28204e000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:3.0:1790772188.465342:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772188.465353:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790772188.465361:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790772188.465362:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8df27abc3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:3.0:1790772188.465378:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790772188.465382:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790772188.465385:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790772188.465418:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772188.465425:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790772188.465456:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772188.465463:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df28204e000/0xdf68d9a7d6a8feac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8feb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772188.465479:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772188.465480:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772188.465482:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772188.465501:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772188.465521:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428556672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772188.465595:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877760428556544:0@lo:39:umount.0 00000100:00100000:3.0:1790772188.465622:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772188.465648:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772188.465779:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428556672 00000100:00100000:0.0:1790772188.465789:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428556672 00000100:00100000:0.0:1790772188.465859:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790772188.465870:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246095850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3294:x1877760428556672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772188.465887:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772188.465905:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241391600/0xdf68d9a7d6a8feb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf68d9a7d6a8feac expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.465920:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772188.465969:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246095850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:3294:x1877760428556672:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772188.465977:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790772188.466050:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428556672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772188.466470:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428556544 00000100:00100000:1.0:1790772188.466476:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428556544 00000100:00100000:1.0:1790772188.466530:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790772188.466539:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27fcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877760428556544:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790772188.466751:0:5825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fc36 00000100:00080000:1.0:1790772188.466762:0:5825:0:(import.c:65:import_set_state_nolock()) ffff8df27abc4000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790772188.466843:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27fcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3292:x1877760428556544:12345-0@lo:39:umount.0 Request processed in 305us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772188.466850:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1790772188.466873:0:5825:0:(genops.c:885:class_export_put()) final put ffff8df27abc1800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1790772188.466966:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772188.467021:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df27abc3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790772188.467043:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877760428556544:0@lo:39:umount.0 00000100:00080000:1.0:1790772188.467179:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790772188.467183:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790772188.467188:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790772188.468122:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27abc1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790772188.468217:0:2348:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df27abc4000 for lustre-MDT0000 00010000:00010000:1.0:1790772188.468408:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468422:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468432:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468440:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468729:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772188.468740:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468748:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468754:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468760:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468822:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790772188.468845:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468853:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468860:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.468867:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469342:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790772188.469352:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469361:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df28204f200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1790772188.469366:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469376:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772188.469385:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772188.469403:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790772188.469406:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1790772188.469444:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469462:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772188.469509:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469516:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df28204f200/0xdf68d9a7d6a8feba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fec1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469532:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772188.469536:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469541:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1790772188.469543:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469576:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772188.469582:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772188.469587:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790772188.469589:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1790772188.469591:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790772188.469616:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469643:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772188.469665:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469715:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df241390200/0xdf68d9a7d6a8fde1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fde8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469731:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772188.469734:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469739:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1790772188.469742:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469749:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772188.469756:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772188.469761:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790772188.469763:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1790772188.469777:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469783:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772188.469789:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.469807:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772188.469809:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772188.469811:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772188.469841:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fa06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428556928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772188.469927:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772188.469987:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772188.469993:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428557056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772188.470030:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772188.470088:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428556928 00000100:00100000:0.0:1790772188.470097:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428556928 00000100:00100000:2.0:1790772188.470191:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428556800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772188.470234:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772188.470705:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772188.470707:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790772188.470717:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a900d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a900dc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772188.470731:0:12940:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790772188.470741:0:12940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.470749:0:12940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.470757:0:12940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.470764:0:12940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.470779:0:12940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790772188.470782:0:12940:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1790772188.470793:0:12940:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1790772188.470814:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772188.470823:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790772188.470829:0:12940:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1790772188.470836:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1790772188.470842:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772188.470849:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1790772188.470867:0:12940:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8df27c045800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790772188.470873:0:12940:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8df248b91800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790772188.470881:0:12940:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8df248b56800 b4ee020b-4bbb-4a28-b296-bb1d54b5868f 192.168.206.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790772188.470887:0:12940:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8df27c041000 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 192.168.206.27@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1790772188.470892:0:12940:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8df26fb1b380) has exports, disconnecting them 00000020:00080000:1.0:1790772188.470897:0:12940:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df27c045800), last request at 1790772183 00010000:00010000:3.0:1790772188.470903:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031800 already unused, calling callback (ffffffffc1adcc20) 00000020:00000080:1.0:1790772188.470907:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fda9 10000000:00010000:3.0:1790772188.470915:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772188.470925:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790772188.470926:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8df27c046000 : changing import state from FULL to CLOSED 10000000:00010000:3.0:1790772188.470939:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772188.470946:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790772188.470949:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790772188.470951:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:1.0:1790772188.470978:0:12940:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df27c045800): rc 0 00010000:00010000:3.0:1790772188.470979:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790772188.470983:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df27c045800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1790772188.470990:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1790772188.470997:0:12940:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df248b91800), last request at 1790772183 00000020:00000080:1.0:1790772188.471001:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fcde 00000100:00080000:1.0:1790772188.471006:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8df248b95800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790772188.471010:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772188.471020:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a8fb95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fb9c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790772188.471020:0:12940:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df248b91800): rc 0 00000020:00000080:1.0:1790772188.471025:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df248b91800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1790772188.471036:0:12940:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0594163fae0 00010000:00010000:3.0:1790772188.471044:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772188.471047:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772188.471050:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790772188.471062:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790772188.471067:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1790772188.471093:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790772188.471163:0:12940:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790772188.471176:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8df248a87000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790772188.471189:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790772188.471191:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1790772188.471205:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790772188.471295:0:12940:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790772188.471305:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8df248b50000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1790772188.471335:0:12940:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8df26fb1b380) has no exports 00000100:00100000:0.0:1790772188.471905:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428557056 00000100:00100000:0.0:1790772188.471914:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428557056 00000100:00100000:0.0:1790772188.471955:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428556800 00000100:00100000:0.0:1790772188.471958:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428556800 00000100:00100000:0.0:1790772188.471977:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790772188.471985:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+20:3295:x1877760428556928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772188.472000:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790772188.472142:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772188.472152:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+20:3295:x1877760428557056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772188.472160:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772188.472170:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a900dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf68d9a7d6a900d5 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772188.472187:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772188.472336:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+19:3295:x1877760428557056:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772188.472343:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790772188.472361:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790772188.472367:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+18:3294:x1877760428556800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772188.472374:0:7617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772188.472382:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f8d8000/0xdf68d9a7d6a8fec1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf68d9a7d6a8feba expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772188.472392:0:7617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772188.472413:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:3294:x1877760428556800:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772188.472419:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790772188.472588:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428557056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772188.472715:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428557312:0@lo:9:umount.0 00000100:00100000:2.0:1790772188.472760:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772188.472795:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428557440:0@lo:9:umount.0 00000100:00100000:3.0:1790772188.472810:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428557312 00000100:00100000:2.0:1790772188.472817:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772188.472818:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428557312 00000100:00100000:2.0:1790772188.472850:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428557440 00000100:00100000:2.0:1790772188.472854:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428557440 00000100:00100000:2.0:1790772188.472894:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790772188.472900:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877760428557440:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790772188.472924:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fe12 00000100:00080000:2.0:1790772188.472933:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8df248b52800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790772188.472968:0:6677:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790772188.473630:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428557184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772188.473672:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772188.473722:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428557184 00000100:00100000:1.0:1790772188.473727:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428557184 00000100:00100000:1.0:1790772188.473757:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772188.473763:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+17:3293:x1877760428557184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790772188.473774:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772188.473789:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df28204f400/0xdf68d9a7d6a8fb9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fb95 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772188.473807:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772188.473833:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f9eb452-8c57-4388-9743-b6ab49eaf81d+16:3293:x1877760428557184:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772188.473840:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772188.473869:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3293:1877760428557184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772188.474179:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3292:x1877760428557440:12345-0@lo:9:umount.0 Request processed in 1277us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772188.474187:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1790772188.474278:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790772188.474296:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772188.474319:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428556800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772188.474393:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2414a2000/0xdf68d9a7d6a8fde8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf68d9a7d6a8fde1 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772188.474412:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772188.474469:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f9eb452-8c57-4388-9743-b6ab49eaf81d+14:3295:x1877760428556928:12345-0@lo:103:ldlm_bl.0 Request processed in 2483us (4541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772188.474477:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00000080:0.0:1790772188.474517:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27c045800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1790772188.474610:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df248b91800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1790772188.474647:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df27c046000 for lustre-MDT0000 00000020:00000080:0.0:1790772188.474666:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df248b95800 for lustre-MDT0000 00010000:00010000:0.0:1790772188.474683:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772188.474711:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790772188.474724:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877760428557312:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790772188.474750:0:6678:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fd2b 00000100:00080000:3.0:1790772188.474758:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8df243043000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790772188.474796:0:6678:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:2.0:1790772188.474814:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790772188.474823:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772188.474844:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fa06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428556928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772188.475462:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3292:x1877760428557312:12345-0@lo:9:umount.0 Request processed in 739us (2699us total) trans 0 rc 0/0 00000100:00080000:1.0:1790772188.475624:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df248b50000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790772188.475642:0:3292:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790772188.475644:0:3292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772188.475648:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428557440:0@lo:9:umount.0 00000100:00080000:1.0:1790772188.475669:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df248a87000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790772188.475872:0:3292:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:3.0:1790772188.475910:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1790772188.476887:0:3292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772188.476953:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428557312:0@lo:9:umount.0 00000020:00080000:1.0:1790772188.483187:0:12940:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8df26fb1b380) has no exports 00000020:00000080:1.0:1790772188.566642:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fbf0 00000020:00000080:1.0:1790772188.566657:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df26f67f000/lustre-QMT0000_UUID 00000020:01000000:1.0:1790772188.566676:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790772188.567107:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df26f67f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1790772188.567132:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772188.567142:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790772188.567146:0:12940:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8df258e00000) has no exports 00000020:00000080:0.0:1790772188.570590:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fbe9 00000020:00000080:0.0:1790772188.570622:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df27c0f5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790772188.570706:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27c0f5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790772188.570740:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772188.570755:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790772188.570759:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df27abb8800/lustre-QMT0000_UUID 00000020:00000080:0.0:1790772188.570761:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27abb8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790772188.570768:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1790772188.641157:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790772188.641186:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428557696:0@lo:400:kworker.0 00000100:00100000:3.0:1790772188.641280:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772188.641425:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772188.641438:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428557568:0@lo:400:kworker.0 00000100:00100000:1.0:1790772188.641497:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772188.641990:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428557696 00000100:00100000:3.0:1790772188.642004:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428557696 00000100:00100000:3.0:1790772188.642058:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428557568 00000100:00100000:3.0:1790772188.642062:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428557568 00000100:00100000:3.0:1790772188.642093:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790772188.642102:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1877760428557696:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790772188.642124:0:5823:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790772188.642185:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1877760428557696:12345-0@lo:400:kworker.0 Request processed in 82us (904us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790772188.642193:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790772188.642213:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1790772188.642218:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3293:x1877760428557568:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790772188.642222:0:5823:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790772188.642254:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3293:x1877760428557568:12345-0@lo:400:kworker.0 Request processed in 35us (766us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790772188.642260:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1790772188.642303:0:3296:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790772188.642309:0:3296:0:(import.c:65:import_set_state_nolock()) ffff8df27c040800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790772188.642313:0:3296:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790772188.642820:0:3293:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790772188.642824:0:3293:0:(import.c:65:import_set_state_nolock()) ffff8df26f67a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790772188.642827:0:3293:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790772188.642833:0:3293:0:(import.c:65:import_set_state_nolock()) ffff8df26f67a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772188.642838:0:3293:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 152 00000100:00080000:1.0:1790772188.642849:0:3293:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df26f67a000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1790772188.642882:0:3293:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df26fa07800 x1877760428557824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772188.642907:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428557568:0@lo:400:kworker.0 00000100:00100000:1.0:1790772188.642940:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1877760428557824:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790772188.642977:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772188.643289:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428557824 00000100:00100000:0.0:1790772188.643299:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428557824 00000100:00100000:0.0:1790772188.643359:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790772188.643368:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1877760428557824:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1790772188.643390:0:5825:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790772188.679403:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1877760428557824:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 36028us (36417us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790772188.679423:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1790772188.679817:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df26f67a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772188.679824:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790772188.679829:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1877760428557824:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1790772188.688622:0:3296:0:(import.c:65:import_set_state_nolock()) ffff8df27c040800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790772188.688642:0:3296:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 171 00000100:00080000:3.0:1790772188.689415:0:3296:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df27c040800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:2.0:1790772188.689925:0:3296:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27401d500 x1877760428557952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772188.689972:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428557696:0@lo:400:kworker.0 00000100:00100000:1.0:1790772188.690159:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1877760428557952:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1790772188.690242:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772188.690680:0:6701:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428557952 00000100:00100000:2.0:1790772188.690698:0:6701:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428557952 00000100:00100000:2.0:1790772188.690759:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790772188.690778:0:6701:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3292:x1877760428557952:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1790772188.690801:0:6701:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790772188.690991:0:6701:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3292:x1877760428557952:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 212us (747us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790772188.691000:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1790772188.691095:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df27c040800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772188.691102:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790772188.691106:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1877760428557952:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1790772189.216013:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790772189.750748:0:5845:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b4ee020b-4bbb-4a28-b296-bb1d54b5868f 00000001:00080000:2.0:1790772189.750782:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1790772189.750795:0:5845:0:(genops.c:885:class_export_put()) final put ffff8df248b56800/b4ee020b-4bbb-4a28-b296-bb1d54b5868f 00000001:00100000:2.0:1790772189.750820:0:5845:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000001:00080000:2.0:1790772189.750825:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1790772189.750841:0:5845:0:(genops.c:885:class_export_put()) final put ffff8df27c041000/9271f5fd-fa87-4f6b-a8bf-0936e195e8be 00000020:00000080:0.0:1790772189.750940:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df248b56800/b4ee020b-4bbb-4a28-b296-bb1d54b5868f for lustre-MDT0000 00000020:00000080:0.0:1790772189.751023:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27c041000/9271f5fd-fa87-4f6b-a8bf-0936e195e8be for lustre-MDT0000 00000020:00000080:0.0:1790772189.751072:0:2348:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df248b53800 for lustre-MDT0000 00000020:00000080:0.0:1790772189.751078:0:2348:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df273eba800 for lustre-MDT0000 00010000:00010000:2.0:1790772190.240951:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790772190.258939:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790772190.258949:0:7629:0:(genops.c:885:class_export_put()) final put ffff8df248b57800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790772190.259054:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df248b57800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1790772190.259189:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df248b52800 for lustre-OST0001 00000020:01000000:0.0:1790772190.624058:0:12940:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8df1411714e0 - data ffff8df27ffcda20/ffff8df141210c00 00000020:01000000:0.0:1790772190.624228:0:12940:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8df245631960 - data ffff8df265819af8/ffff8df2430dec00 00000001:00000004:0.0:1790772190.636051:0:12940:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1790772190.780101:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790772190.780112:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1790772190.780144:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790772190.780148:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790772190.781621:0:6779:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790772190.781630:0:6779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1790772190.781643:0:6779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1790772190.782767:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790772190.782773:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1790772190.782786:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790772190.782789:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790772190.783217:0:8044:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790772190.783222:0:8044:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1790772190.783237:0:8044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1790772190.842263:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fbb8 00000020:00000080:1.0:1790772190.842280:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df26fb2a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790772190.847885:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df26fb2a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790772190.849082:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fbcd 00000020:00000080:1.0:1790772190.849098:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df26fb2b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790772190.849215:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1790772190.849228:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772190.849239:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790772190.849244:0:12940:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8df26fb18000) has no exports 00000004:01000000:1.0:1790772190.849469:0:12940:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1790772190.849489:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fe0b 00000020:00000080:1.0:1790772190.849494:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df27abc5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790772190.850419:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df26fb2b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790772190.850571:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790772190.850579:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772190.850589:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790772190.850593:0:12940:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8df27fad0000) has no exports 00000020:00000080:1.0:1790772190.850602:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fe04 00000020:00000080:1.0:1790772190.850608:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df248b54800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790772190.850699:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27abc5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1790772190.851544:0:12940:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000020:00000080:0.0:1790772190.851650:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df248b54800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:1.0:1790772190.851906:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790772190.851911:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1790772190.851919:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772190.851921:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790772190.851978:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772190.851991:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772190.852006:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fd24 00000020:00000080:1.0:1790772190.852013:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df27d3b7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790772190.852019:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790772190.852041:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772190.852047:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790772190.852050:0:12940:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8df2590719c0) has no exports 00000020:00000080:1.0:1790772190.852057:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fd1d 00000020:00000080:1.0:1790772190.852062:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df248a86000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1790772190.852461:0:12940:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790772190.852464:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790772190.852467:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1790772190.852471:0:12940:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790772190.852473:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790772190.852532:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772190.852538:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790772190.852652:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df248b50000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790772190.852662:0:37:0:(genops.c:885:class_export_put()) final put ffff8df258e9f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790772190.852664:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df258e9f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790772190.852672:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790772190.852784:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27d3b7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790772190.852790:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df248a86000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790772190.852795:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df248a87000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790772190.852799:0:37:0:(genops.c:885:class_export_put()) final put ffff8df141327800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790772190.852801:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df141327800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1790772190.852805:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772190.853292:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772190.853300:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772190.853303:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df258e9a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790772190.853305:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8df258e9a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790772190.853312:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772190.853457:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fbd4 00000020:00000080:1.0:1790772190.853466:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df26fb28000/lustre-MDD0000_UUID 00000020:01000000:1.0:1790772190.853496:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790772190.853501:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772190.853507:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790772190.853511:0:12940:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8df26fb1cd40) has no exports 00000020:00000080:1.0:1790772190.853535:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772190.853538:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790772190.853541:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fbdb 00000020:00000080:1.0:1790772190.853545:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df26fb2c800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790772190.853617:0:12940:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df258965000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790772190.853621:0:12940:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df258965000 3 00000020:01000004:1.0:1790772190.853625:0:12940:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df258965000 from lustre-MDT0000 00000020:00000080:1.0:1790772190.853645:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772190.853650:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790772190.853665:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df26fb2f800/lustre-MDT0000_UUID 00000020:00000080:1.0:1790772190.853667:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8df26fb2f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790772190.853674:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790772190.853703:0:12940:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1790772190.853707:0:12940:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790772190.853711:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790772190.853713:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772190.853716:0:12940:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790772190.853724:0:12940:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8df245b7f000 6f9eb452-8c57-4388-9743-b6ab49eaf81d 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790772190.853730:0:12940:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8df248b38000) has exports, disconnecting them 00000020:00080000:1.0:1790772190.853735:0:12940:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8df245b7f000), last request at 1790771966 00000020:00000080:1.0:1790772190.853751:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fb79 00000020:00010000:1.0:1790772190.853824:0:12940:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8df245b7f000: total 2 00000100:00080000:1.0:1790772190.853830:0:12940:0:(import.c:65:import_set_state_nolock()) ffff8df245b79000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1790772190.853919:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df26fb28000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1790772190.853925:0:37:0:(genops.c:885:class_export_put()) final put ffff8df26fb2d800/lustre-MDD0000_UUID 00000020:00000080:0.0:1790772190.853927:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df26fb2d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1790772190.853931:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1790772190.854207:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df26fb2c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1790772190.854249:0:12940:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df245b7f000): rc 0 00000020:00080000:1.0:1790772190.854254:0:12940:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8df248b38000) has no exports 00000100:00100000:1.0:1790772190.854378:0:5818:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff8df2590eae00:5818] 2 exiting: rc = 0 00000100:00100000:0.0:1790772190.854532:0:5817:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff8df248ab8600:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1790772190.854704:0:5816:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff8df2590ea800:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1790772190.855171:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855181:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855189:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855197:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855203:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855208:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855214:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855221:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855227:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855235:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855242:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855251:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855257:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855263:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855270:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855288:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855295:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855301:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855307:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855314:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855321:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855327:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855334:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855341:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855348:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855354:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855361:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855368:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855374:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855380:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855386:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855392:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855397:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855403:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855409:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855414:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855420:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855426:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855432:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855438:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855444:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855451:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855458:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855464:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855471:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855521:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855527:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855533:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855539:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855545:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855578:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855583:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855590:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855597:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855603:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855609:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855614:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855620:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855626:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855632:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855637:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855643:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855649:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772190.855657:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1790772190.856133:0:12940:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790772190.856136:0:12940:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1790772190.856745:0:12940:0:(ldlm_resource.c:1200:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fc91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc8a expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856775:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df28204ec00/0xdf68d9a7d6a8fc91 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fc8a expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856795:0:12940:0:(ldlm_resource.c:1200:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fe7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe74 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856806:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241390a00/0xdf68d9a7d6a8fe7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe74 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856816:0:12940:0:(ldlm_resource.c:1200:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fe89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe82 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856825:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df28204f000/0xdf68d9a7d6a8fe89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe82 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856846:0:12940:0:(ldlm_resource.c:1200:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8df26f9b9000/0xdf68d9a7d6a8fe97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe90 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856855:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b9000/0xdf68d9a7d6a8fe97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe90 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856864:0:12940:0:(ldlm_resource.c:1200:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8df26f9b9200/0xdf68d9a7d6a8fea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe9e expref: 5 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856873:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b9200/0xdf68d9a7d6a8fea5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fe9e expref: 5 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856882:0:12940:0:(ldlm_resource.c:1200:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8df26f9b8000/0xdf68d9a7d6a8fecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fec8 expref: 4 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856889:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b8000/0xdf68d9a7d6a8fecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xdf68d9a7d6a8fec8 expref: 4 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856902:0:12940:0:(ldlm_resource.c:1200:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8df26f9ab000/0xdf68d9a7d6a900c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xdf68d9a7d6a900b9 expref: 3 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856910:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9ab000/0xdf68d9a7d6a900c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xdf68d9a7d6a900b9 expref: 3 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856918:0:12940:0:(ldlm_resource.c:1200:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8df26f9ab400/0xdf68d9a7d6a900ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xdf68d9a7d6a900c7 expref: 2 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772190.856926:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9ab400/0xdf68d9a7d6a900ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xdf68d9a7d6a900c7 expref: 2 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1790772190.857540:0:5811:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8df245b7f000: total 0 00010000:00010000:3.0:1790772190.857614:0:5811:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df245b7f000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1790772190.857626:0:5811:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df245b7f000, canceled 0 locks, left on hash table 0. 00000020:00000080:3.0:1790772190.857634:0:5811:0:(genops.c:885:class_export_put()) final put ffff8df245b7f000/6f9eb452-8c57-4388-9743-b6ab49eaf81d 00010000:00010000:3.0:1790772190.857648:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772190.857651:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772190.857653:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790772190.857700:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df245b7f000/6f9eb452-8c57-4388-9743-b6ab49eaf81d for MGS 00000020:00000080:0.0:1790772190.857739:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df245b79000 for MGS 00010000:00010000:2.0:1790772191.265598:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772192.288385:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790772192.814053:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790772192.814068:0:6704:0:(genops.c:885:class_export_put()) final put ffff8df243046800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790772192.817859:0:12647:0:(genops.c:844:class_export_destroy()) destroying export ffff8df243046800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790772192.817977:0:12647:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df243043000 for lustre-OST0000 00000020:01000000:1.0:1790772192.864138:0:12940:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8df26fa59d80 - data ffff8df27fe72e58/ffff8df26f629400 00000020:01000000:1.0:1790772192.864322:0:12940:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8df2450fa540 - data ffff8df25eb8ae58/ffff8df258e83c00 00000020:00000080:1.0:1790772192.867050:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fb5d 00000020:00000080:1.0:1790772192.867065:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df246f0d000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790772192.867097:0:12940:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df258965000 from MGS, refs=2 00000020:01000004:1.0:1790772192.867101:0:12940:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df258965000 2 00000020:01000004:1.0:1790772192.867106:0:12940:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df258965000 from MGS 00000020:00000080:1.0:1790772192.867141:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772192.867151:0:12940:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1790772192.867154:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df246f0f000/MGS 00000020:00000080:1.0:1790772192.867158:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8df246f0f000/MGS for MGS 00000020:01000000:1.0:1790772192.867166:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1790772192.867241:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790772192.867247:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772192.867254:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790772192.867263:0:12940:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8df27abc2000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790772192.867269:0:12940:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8df248b3b380) has exports, disconnecting them 00000020:00080000:1.0:1790772192.867275:0:12940:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8df27abc2000), last request at 1790771967 00000020:00000080:1.0:1790772192.867280:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fc28 00000020:00080000:1.0:1790772192.867287:0:12940:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df27abc2000): rc 0 00000020:00000080:1.0:1790772192.867291:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df27abc2000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790772192.869295:0:12940:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790772192.869306:0:12940:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790772192.869312:0:12940:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790772192.869321:0:12940:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790772192.869537:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772192.869678:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df246f0d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790772192.869699:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27abc2000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790772192.869706:0:2348:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df27abc3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790772192.870885:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790772192.870893:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df27abc5800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790772192.870898:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27abc5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790772192.870907:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790772192.870996:0:12940:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df258965000 1 00000020:00000080:1.0:1790772192.872368:0:12940:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fb4f 00000020:00000080:1.0:1790772192.872382:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df246f0a000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790772192.872488:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1790772192.872692:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772192.872702:0:12940:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790772192.872724:0:12940:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8df2581c8000) has no exports 00000020:00000080:3.0:1790772192.880809:0:2348:0:(genops.c:844:class_export_destroy()) destroying export ffff8df246f0a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790772192.990335:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772192.990360:0:12940:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1790772192.990367:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df258967800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790772192.990372:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8df258967800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1790772192.990392:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1790772192.990706:0:12940:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df258967000 00000020:01000000:2.0:1790772192.990737:0:12940:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1790772192.991894:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772192.991907:0:12940:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790772192.991913:0:12940:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8df258e019c0) has no exports 00000100:00100000:0.0:1790772192.995226:0:5823:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff8df258e94c00:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1790772192.995389:0:5824:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff8df258e53c00:5824] 1 exiting: rc = 0 00000100:00100000:2.0:1790772192.995581:0:6701:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff8df27af51e00:6701] 3 exiting: rc = 0 00000100:00100000:1.0:1790772192.996088:0:5825:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff8df258e94400:5825] 2 exiting: rc = 0 00000100:00100000:2.0:1790772192.996228:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996237:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996243:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996250:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996259:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996266:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996273:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996279:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996286:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996293:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996299:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996307:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996314:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996320:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996327:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996333:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996340:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996347:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996354:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996360:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996366:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996372:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996378:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996384:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996391:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996398:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996405:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996412:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996419:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996426:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996434:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996463:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996482:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996489:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996495:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996501:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996508:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996515:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996522:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996528:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996534:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996541:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996933:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996941:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996949:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996957:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996964:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996972:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996978:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996983:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996989:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.996997:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997004:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997011:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997085:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997093:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997098:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997104:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997111:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997118:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997128:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997135:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997141:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772192.997163:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772193.006305:0:5826:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8df258e94a00:5826] 0 exiting: rc = 1 00000100:00100000:2.0:1790772193.011110:0:5827:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8df258e53800:5827] 1 exiting: rc = 0 00000100:00100000:3.0:1790772193.011335:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011347:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011355:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011362:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011370:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011377:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011408:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011414:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011421:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011427:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011434:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011441:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011449:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011455:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011461:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011479:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011486:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011491:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011497:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011503:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011509:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011515:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011521:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011527:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011533:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011539:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011545:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011579:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011585:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011591:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011597:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011602:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011608:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011613:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011619:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011639:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011645:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011651:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011657:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011663:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011669:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011686:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011692:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011697:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011702:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011707:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011713:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011719:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011726:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011731:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011737:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011925:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011936:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011942:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011947:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011953:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011959:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011964:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011970:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011975:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011980:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011986:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011993:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.011999:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790772193.017349:0:5829:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff8df258e52a00:5829] 1 exiting: rc = 0 00000100:00100000:3.0:1790772193.020390:0:5828:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff8df2591ed400:5828] 0 exiting: rc = 1 00000100:00100000:0.0:1790772193.020615:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020684:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020692:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020699:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020706:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020713:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020720:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020888:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020898:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020905:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020913:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020921:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020928:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020935:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020942:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020952:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020960:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020967:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020975:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.020998:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021012:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021020:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021028:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021036:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021042:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021049:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021056:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021063:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021070:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021076:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021087:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021115:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021137:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021145:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021154:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021160:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021167:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021175:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021182:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021191:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021199:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021206:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021213:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021269:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021278:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021285:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021292:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021299:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021306:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021312:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021319:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021326:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021333:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021339:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021347:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021369:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021378:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021385:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021392:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021400:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021406:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021412:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021419:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.021426:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.056961:0:5830:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8df2591ec800:5830] 0 exiting: rc = 1 00000100:00100000:1.0:1790772193.057320:0:5831:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8df2591e9a00:5831] 1 exiting: rc = 0 00000100:00100000:3.0:1790772193.057434:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057445:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057452:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057458:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057475:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057482:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057488:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057498:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057507:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057516:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057540:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057546:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057575:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057581:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057587:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057593:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057598:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057604:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057609:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057614:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057632:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057640:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057645:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057651:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057656:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057662:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057668:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057673:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057679:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057684:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057690:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057695:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057704:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057713:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057720:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057726:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057732:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057738:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057847:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057854:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057860:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057865:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057871:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057876:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057881:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057895:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057900:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057907:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057913:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057918:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057929:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057935:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057941:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057948:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057953:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057958:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057964:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057971:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057976:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057981:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057986:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057991:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.057996:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.058000:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059019:0:5833:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8df2591e8800:5833] 1 exiting: rc = 0 00000100:00100000:2.0:1790772193.059062:0:5832:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8df258e4c200:5832] 0 exiting: rc = 1 00000100:00100000:3.0:1790772193.059105:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059112:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059118:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059123:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059128:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059134:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059140:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059146:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059153:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059158:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059165:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059171:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059177:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059182:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059188:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059202:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059207:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059212:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059217:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059223:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059229:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059235:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059240:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059245:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059251:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059263:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059269:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059274:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059279:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059285:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059291:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059297:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059302:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059307:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059312:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059317:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059322:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059327:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059333:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059338:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059343:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059349:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059354:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059359:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059364:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059369:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059374:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059379:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059385:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059391:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059406:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059412:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059418:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059424:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059430:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059435:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059440:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059446:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059451:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059457:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059463:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059989:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.059995:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.060001:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.060638:0:5834:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff8df258e4d600:5834] 0 exiting: rc = 1 00000100:00100000:0.0:1790772193.061163:0:5835:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff8df259116e00:5835] 1 exiting: rc = 0 00000100:00100000:3.0:1790772193.061297:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061305:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061311:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061317:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061322:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061328:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061334:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061340:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061346:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061351:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061358:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061364:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061370:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061376:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061381:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061387:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061392:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061397:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061403:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061409:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061414:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061441:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061447:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061452:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061458:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.061464:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063889:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063897:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063903:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063909:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063915:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063921:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063926:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063932:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063937:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063943:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063948:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063954:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063960:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063966:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063972:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063978:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063986:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063992:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.063998:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064004:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064010:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064015:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064021:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064027:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064032:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064038:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064044:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064050:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064056:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064061:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064091:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064097:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064103:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064108:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064114:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064119:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064125:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790772193.064131:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772193.066196:0:5836:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff8df25913c000:5836] 0 exiting: rc = 1 00000100:00100000:2.0:1790772193.068325:0:5837:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff8df259117e00:5837] 1 exiting: rc = 0 00000100:00100000:2.0:1790772193.068762:0:5838:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff8df26e5d1400:5838] 2 exiting: rc = 0 00000100:00100000:2.0:1790772193.069452:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069490:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069499:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069505:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069512:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069518:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069525:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069532:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069538:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069545:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069579:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069664:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069673:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069679:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069686:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069694:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069701:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069709:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069783:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069789:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069795:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069802:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069808:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069815:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069821:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069842:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069919:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069928:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069939:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069944:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069950:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069970:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069976:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069982:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069988:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.069994:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070001:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070008:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070015:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070021:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070028:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070034:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070040:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070047:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070054:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070061:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070067:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070074:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070080:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070174:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070184:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070191:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070197:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070203:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070210:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070217:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070223:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070230:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070236:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070243:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070248:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070254:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070261:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772193.070268:0:12940:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790772193.078342:0:12940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772193.078359:0:12940:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1790772193.078381:0:12940:0:(genops.c:885:class_export_put()) final put ffff8df242c79000/MDS_uuid 00000020:00000080:2.0:1790772193.078387:0:12940:0:(genops.c:844:class_export_destroy()) destroying export ffff8df242c79000/MDS_uuid for MDS 00000020:01000000:2.0:1790772193.078393:0:12940:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1790772193.078697:0:12940:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1790772193.317095:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772193.760958:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428558080:0@lo:400:kworker.0 00000400:00000100:2.0:1790772193.761038:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877760428558080 offset 0 length 224: 4 00000100:00080000:0.0:1790772193.761133:0:12647:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790772193.761145:0:12647:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790772193.761150:0:12647:0:(import.c:65:import_set_state_nolock()) ffff8df26f67a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772193.761157:0:12647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 354 00000100:00080000:0.0:1790772193.761164:0:12647:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790772193.761176:0:12647:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df26f67a000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1790772193.761203:0:12647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27ae0f100 x1877760428558208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772193.761237:0:12647:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790772193.761241:0:12647:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790772193.761243:0:12647:0:(import.c:65:import_set_state_nolock()) ffff8df27c040800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772193.761247:0:12647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 354 00000100:00080000:0.0:1790772193.761249:0:12647:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790772193.761254:0:12647:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df27c040800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1790772193.761267:0:12647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27ae0ce00 x1877760428558336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790772193.761321:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1877760428558208:0@lo:38:kworker.0 00000400:00000100:3.0:1790772193.761366:0:3292:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760428558208 offset 0 length 520: 4 00000100:00100000:3.0:1790772193.761382:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1877760428558336:0@lo:38:kworker.0 00000400:00000100:3.0:1790772193.761399:0:3292:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877760428558336 offset 0 length 520: 4 00010000:00010000:1.0:1790772194.335982:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772195.362696:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790772196.224899:0:13095:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790772196.258304:0:13095:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1790772196.258376:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.258397:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.258406:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.258415:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.258456:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790772196.258464:0:13095:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790772196.258496:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772196.258511:0:13095:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df27ae0f100 x1877760428558208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772208 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772196.258579:0:13095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790772196.258627:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df26f67a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790772196.258633:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1790772196.258638:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1877760428558208:0@lo:38:kworker.0 00000100:00080000:3.0:1790772196.258677:0:13095:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790772196.258684:0:13095:0:(import.c:65:import_set_state_nolock()) ffff8df26f67a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1790772196.258690:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772196.258692:0:13095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790772196.258696:0:13095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790772196.259641:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.259656:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.259663:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.259670:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.259687:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790772196.259695:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.259702:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.259724:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.259730:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772196.259738:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1790772196.259742:0:13095:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1790772196.259770:0:13095:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1790772196.259775:0:13095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1790772196.259780:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772196.259786:0:13095:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790772196.259791:0:13095:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8df27fad19c0) has no exports 00000020:00080000:3.0:1790772196.259821:0:13095:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8df27fad19c0) has no exports 00010000:00010000:2.0:1790772196.261193:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790772196.261209:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261221:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772196.261225:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261236:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772196.261244:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772196.261250:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772196.261253:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790772196.261256:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790772196.261327:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261334:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772196.261373:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261396:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df241391400/0xdf68d9a7d6a8fe90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fe97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261414:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772196.261418:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261423:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772196.261426:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261432:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772196.261438:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772196.261443:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772196.261445:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1790772196.261447:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1790772196.261474:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261480:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772196.261486:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261493:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8400/0xdf68d9a7d6a8fe9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a8fea5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261513:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772196.261517:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261522:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772196.261524:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261531:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772196.261537:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772196.261541:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790772196.261543:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790772196.261545:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790772196.261579:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261585:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772196.261613:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261620:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a900c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf68d9a7d6a900ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772196.261629:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772196.261631:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772196.261639:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772196.261648:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772196.261669:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428558592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772196.261752:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772196.261821:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790772196.261828:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428558464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772196.261851:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772196.261882:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428558720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772196.261925:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772196.261962:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428558592 00000100:00100000:2.0:1790772196.261972:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428558592 00000100:00100000:2.0:1790772196.262012:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428558464 00000100:00100000:2.0:1790772196.262016:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428558464 00000100:00100000:2.0:1790772196.262025:0:7617:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428558720 00000100:00100000:2.0:1790772196.262028:0:7617:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428558720 00000100:00100000:2.0:1790772196.262041:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790772196.262049:0:7617:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3294:x1877760428558592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790772196.262056:0:7617:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790772196 with bad export cookie 16098356182920002425 00000100:00100000:0.0:1790772196.264919:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772196.264935:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3294:x1877760428558464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790772196.264947:0:5810:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790772196 with bad export cookie 16098356182920002425 00000100:00100000:0.0:1790772196.265064:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3294:x1877760428558464:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (3211us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790772196.265071:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772196.265101:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790772196.265106:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df246096850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3295:x1877760428558720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790772196.265110:0:5810:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790772196 with bad export cookie 16098356182920002425 00000100:00100000:0.0:1790772196.265138:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df246096850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3295:x1877760428558720:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (3212us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790772196.265163:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1790772196.265745:0:3295:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790772196.265750:0:3295:0:(import.c:65:import_set_state_nolock()) ffff8df242c7c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1790772196.265755:0:3295:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:3.0:1790772196.268056:0:13095:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8df1429d0540 - data ffff8df265805e58/ffff8df142720400 00000020:01000000:3.0:1790772196.268261:0:13095:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8df2450ed3c0 - data ffff8df14146e798/ffff8df14137ac00 00000100:00100000:2.0:1790772196.279674:0:7617:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3294:x1877760428558592:12345-0@lo:103:ldlm_bl.0 Request processed in 17616us (17914us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790772196.279689:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1790772196.285720:0:3294:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790772196.310535:0:3295:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.127@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1790772196.310544:0:3295:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790772196.310751:0:3295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df27ae0fb80 x1877760428558080/t0(0) o400->MGC192.168.206.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790772209 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772196.310858:0:3295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df27401ea00 x1877760428558592/t0(0) o103->MGC192.168.206.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790772212 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772196.310870:0:3295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df27401f800 x1877760428558464/t0(0) o103->MGC192.168.206.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790772212 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772196.310880:0:3295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df27401df80 x1877760428558720/t0(0) o103->MGC192.168.206.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790772212 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790772196.310951:0:3295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790772196.310956:0:3295:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790772196.310958:0:3295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790772196.310959:0:3294:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8df242c7c800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1790772196.310963:0:3295:0:(import.c:65:import_set_state_nolock()) ffff8df242c7c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772196.310971:0:3295:0:(import.c:545:import_select_connection()) MGC192.168.206.127@tcp: connect to NID 0@lo last attempt 132 00000100:00080000:0.0:1790772196.310989:0:3295:0:(import.c:666:import_select_connection()) MGC192.168.206.127@tcp: import ffff8df242c7c800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1790772196.310996:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428558592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772196.311035:0:3295:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27ae0e300 x1877760428558848/t0(0) o250->MGC192.168.206.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772196.311086:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3294:1877760428558464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772196.311087:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3295:1877760428558720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772196.313102:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3296:1877760428558080:0@lo:400:kworker.0 00000100:00100000:2.0:1790772196.313366:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3292:1877760428558848:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1790772196.313437:0:3292:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877760428558848 offset 0 length 520: 4 00100000:10000000:3.0:1790772196.331153:0:13095:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790772196.403799:0:13095:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fcad 00000020:00000080:1.0:1790772196.403813:0:13095:0:(genops.c:885:class_export_put()) final put ffff8df248b94000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1790772196.403943:0:13095:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df242cf1800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1790772196.403948:0:13095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df242cf1800 2 00000020:01000004:1.0:1790772196.403952:0:13095:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df242cf1800 from lustre-OST0000 00000020:00000080:1.0:1790772196.403993:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772196.404005:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1790772196.404008:0:13095:0:(genops.c:885:class_export_put()) final put ffff8df248b92000/lustre-OST0000_UUID 00000020:00000080:1.0:1790772196.404011:0:13095:0:(genops.c:844:class_export_destroy()) destroying export ffff8df248b92000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1790772196.404028:0:13095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1790772196.404166:0:13095:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1790772196.404172:0:13095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1790772196.404189:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772196.404195:0:13095:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790772196.404203:0:13095:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8df141322800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790772196.404210:0:13095:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8df2581cb380) has exports, disconnecting them 00000020:00080000:1.0:1790772196.404216:0:13095:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8df141322800), last request at 1790771986 00000020:00000080:1.0:1790772196.404220:0:13095:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fcd7 00000020:00080000:1.0:1790772196.404232:0:13095:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df141322800): rc 0 00000020:00000080:1.0:1790772196.404238:0:13095:0:(genops.c:885:class_export_put()) final put ffff8df141322800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790772196.404387:0:12647:0:(genops.c:844:class_export_destroy()) destroying export ffff8df248b94000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790772196.407406:0:12647:0:(genops.c:844:class_export_destroy()) destroying export ffff8df141322800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1790772196.416197:0:13095:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790772196.416209:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790772196.416236:0:13095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790772196.416245:0:13095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790772196.416496:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772196.416508:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1790772196.416517:0:13095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df242cf1800 1 00000020:00000080:2.0:1790772196.416525:0:13095:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fc67 00000020:00000080:2.0:1790772196.416537:0:13095:0:(genops.c:885:class_export_put()) final put ffff8df2437ee800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1790772196.416543:0:13095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1790772196.416570:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772196.416576:0:13095:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790772196.416580:0:13095:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8df26fb199c0) has no exports 00000020:00000080:3.0:1790772196.416635:0:12647:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df26f67a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790772196.416644:0:12647:0:(genops.c:885:class_export_put()) final put ffff8df243042000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1790772196.416660:0:12647:0:(genops.c:844:class_export_destroy()) destroying export ffff8df243042000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1790772196.416677:0:12647:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1790772196.416754:0:12647:0:(genops.c:844:class_export_destroy()) destroying export ffff8df2437ee800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790772196.459681:0:13095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790772196.459694:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1790772196.459710:0:13095:0:(genops.c:885:class_export_put()) final put ffff8df27c0f1800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790772196.459714:0:13095:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27c0f1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1790772196.459747:0:13095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1790772196.459876:0:13095:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df27ab8b800 00000020:02000400:3.0:1790772196.459918:0:13095:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1790772196.599781:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772197.602374:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772198.630004:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772198.881737:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6f9eb452-8c57-4388-9743-b6ab49eaf81d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772198.881746:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6f9eb452-8c57-4388-9743-b6ab49eaf81d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790772198.881750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790772198.881753:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1790772199.648507:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790772199.832135:0:13245:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790772199.854648:0:13245:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790772199.854750:0:13245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.854768:0:13245:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.854775:0:13245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.854783:0:13245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.854809:0:13245:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790772199.854815:0:13245:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790772199.854848:0:13245:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772199.854864:0:13245:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df27ae0ce00 x1877760428558336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772208 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772199.854887:0:13245:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790772199.854894:0:13245:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790772199.854901:0:13245:0:(import.c:65:import_set_state_nolock()) ffff8df27c040800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790772199.854907:0:13245:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790772199.854911:0:13245:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df27ae0ce00 x1877760428558336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790772208 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772199.854917:0:13245:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790772199.854920:0:13245:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:1.0:1790772199.855519:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1877760428558336:0@lo:38:kworker.0 00010000:00010000:2.0:1790772199.855635:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772199.855644:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.855653:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df28204fe00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772199.855658:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.855669:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772199.855691:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772199.855698:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772199.855700:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790772199.855703:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790772199.855722:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df242c7c800 00010000:00010000:2.0:1790772199.855726:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.855733:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df28204fe00/0xdf68d9a7d6a8fe74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf68d9a7d6a8fe7b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.855747:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772199.855749:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772199.855751:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772199.861476:0:13245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.861502:0:13245:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.861512:0:13245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.861519:0:13245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.862446:0:13245:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772199.862461:0:13245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.862472:0:13245:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.862479:0:13245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772199.862485:0:13245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.866281:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790772199.866314:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.866330:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8c00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772199.866335:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.866348:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772199.866356:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772199.866403:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790772199.866406:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1790772199.866426:0:5812:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df242c7c800 00010000:00010000:2.0:1790772199.866440:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.866448:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a8fe82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf68d9a7d6a8fe89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.866470:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772199.866475:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.866481:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f8d8800 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772199.866484:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.866492:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772199.866499:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772199.866504:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790772199.866507:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790772199.866510:0:5812:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df242c7c800 00010000:00010000:2.0:1790772199.866513:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772199.866530:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772199.866532:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772199.866534:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772199.867741:0:13245:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790772199.867759:0:13245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f8d8800/0xdf68d9a7d6a900b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf68d9a7d6a900c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772199.867790:0:13245:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1790772199.867813:0:13245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1790772199.867816:0:13245:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1790772199.867854:0:13245:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1790772199.867860:0:13245:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1790772199.867882:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790772199.867890:0:13245:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790772199.867895:0:13245:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8df259070000) has no exports 00000020:00080000:3.0:1790772199.867930:0:13245:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8df259070000) has no exports 00010000:00010000:2.0:1790772199.868083:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790772199.872122:0:13245:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8df1429d0ea0 - data ffff8df27fe86e58/ffff8df274592400 00000020:01000000:2.0:1790772199.872325:0:13245:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8df26fa127e0 - data ffff8df265986ca8/ffff8df27acfa800 00100000:10000000:3.0:1790772199.893288:0:13245:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790772199.940298:0:13245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fd78 00000020:00000080:1.0:1790772199.940313:0:13245:0:(genops.c:885:class_export_put()) final put ffff8df273f9e800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790772199.940391:0:13245:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df273e99800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790772199.940396:0:13245:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df273e99800 2 00000020:01000004:1.0:1790772199.940400:0:13245:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df273e99800 from lustre-OST0001 00000020:00000080:1.0:1790772199.940428:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772199.940454:0:13245:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790772199.940458:0:13245:0:(genops.c:885:class_export_put()) final put ffff8df273f9d800/lustre-OST0001_UUID 00000020:00000080:1.0:1790772199.940462:0:13245:0:(genops.c:844:class_export_destroy()) destroying export ffff8df273f9d800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790772199.940474:0:13245:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1790772199.940682:0:13245:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6f9eb452-8c57-4388-9743-b6ab49eaf81d->MGS 00010000:00010000:1.0:1790772199.940702:0:13245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df2414a3800/0xdf68d9a7d6a8fc8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a8fc91 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772199.940730:0:13245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df2414a3800/0xdf68d9a7d6a8fc8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a8fc91 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772199.940737:0:13245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1790772199.940741:0:13245:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1790772199.940745:0:13245:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1790772199.940763:0:13245:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df242c7c800 00010000:00010000:1.0:1790772199.940781:0:13245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df2414a3800/0xdf68d9a7d6a8fc8a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf68d9a7d6a8fc91 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772199.940799:0:13245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f8d9200/0xdf68d9a7d6a8fec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf68d9a7d6a8fecf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772199.940807:0:13245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f8d9200/0xdf68d9a7d6a8fec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf68d9a7d6a8fecf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772199.940812:0:13245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790772199.940815:0:13245:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1790772199.940817:0:13245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1790772199.940829:0:13245:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df242c7c800 00010000:00010000:1.0:1790772199.940832:0:13245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f8d9200/0xdf68d9a7d6a8fec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf68d9a7d6a8fecf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790772199.940856:0:13245:0:(import.c:65:import_set_state_nolock()) ffff8df242c7c800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1790772199.940860:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790772199.940863:0:13245:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790772199.940865:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790772199.940870:0:13245:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790772199.940884:0:13245:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df27ae0e300 x1877760428558848/t0(0) o250->MGC192.168.206.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790772206 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790772199.941102:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790772199.941106:0:13245:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1790772199.943071:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f9eb452-8c57-4388-9743-b6ab49eaf81d:3292:1877760428558848:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:1.0:1790772199.943188:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790772199.943205:0:13245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fb6b 00000020:00000080:1.0:1790772199.943216:0:13245:0:(genops.c:885:class_export_put()) final put ffff8df242c7e800/6f9eb452-8c57-4388-9743-b6ab49eaf81d 00000020:00000080:2.0:1790772199.943289:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df273f9e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790772199.946009:0:13245:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.127@tcp (flags='') 00000020:00000080:1.0:1790772199.946023:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772199.946035:0:13245:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.127@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790772199.946041:0:13245:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8df258e04d40) has no exports 00000020:00000080:2.0:1790772199.946828:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df242c7e800/6f9eb452-8c57-4388-9743-b6ab49eaf81d for MGC192.168.206.127@tcp 10000000:01000000:0.0:1790772199.947124:0:5820:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1790772199.947577:0:13245:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.206.127@tcp: client import never connected 00000100:00080000:1.0:1790772199.947583:0:13245:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1790772199.947588:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790772199.947592:0:13245:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1790772199.947595:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790772199.947665:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790772199.947675:0:13245:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.127@tcp (uuid 6f9eb452-8c57-4388-9743-b6ab49eaf81d) 00000020:01000000:1.0:1790772199.947684:0:13245:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790772199.947689:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790772199.947695:0:13245:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790772199.947703:0:13245:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8df27c041800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:2.0:1790772199.947855:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df242c7c800 for MGC192.168.206.127@tcp 00000020:00000080:2.0:1790772199.947865:0:37:0:(genops.c:885:class_export_put()) final put ffff8df242c7f000/6f9eb452-8c57-4388-9743-b6ab49eaf81d 00000020:00000080:2.0:1790772199.947868:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df242c7f000/6f9eb452-8c57-4388-9743-b6ab49eaf81d for MGC192.168.206.127@tcp 00000020:01000000:2.0:1790772199.947876:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.127@tcp (6f9eb452-8c57-4388-9743-b6ab49eaf81d) 00000020:00080000:1.0:1790772199.948287:0:13245:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8df248b3cd40) has exports, disconnecting them 00000020:00080000:1.0:1790772199.948293:0:13245:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8df27c041800), last request at 1790772005 00000020:00000080:1.0:1790772199.948299:0:13245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fda2 00000020:00080000:1.0:1790772199.948316:0:13245:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df27c041800): rc 0 00000020:00000080:1.0:1790772199.948320:0:13245:0:(genops.c:885:class_export_put()) final put ffff8df27c041800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790772199.949264:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27c041800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790772199.950633:0:13245:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790772199.950641:0:13245:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790772199.950647:0:13245:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790772199.950656:0:13245:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790772199.950908:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1790772199.951043:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8df27c040800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1790772199.951631:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1790772199.951868:0:5806:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8df26d3f2200:5806] 0 exiting: rc = 1 00000100:00100000:0.0:1790772199.956902:0:5807:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8df26d3f3a00:5807] 1 exiting: rc = 0 00000100:00100000:2.0:1790772199.957112:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.957446:0:7617:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8df26f3dae00:7617] 3 exiting: rc = 0 00000100:00100000:0.0:1790772199.957602:0:5810:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8df2465a4e00:5810] 2 exiting: rc = 0 00000100:00100000:2.0:1790772199.958686:0:5808:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8df245099800:5808] 0 exiting: rc = 1 00000100:00100000:0.0:1790772199.958918:0:5809:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8df245098400:5809] 1 exiting: rc = 0 00000100:00100000:2.0:1790772199.959033:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959046:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959054:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959061:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959068:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959075:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959080:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959107:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959114:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959120:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959127:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959133:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959140:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959146:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959154:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959160:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959167:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959174:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959179:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959183:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959189:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959194:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959199:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959205:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959209:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959214:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959219:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959224:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959230:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959236:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959242:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959247:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959252:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959257:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959263:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959268:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959273:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959277:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959282:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959287:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959292:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959297:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959311:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959316:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959321:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959327:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959333:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959338:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959344:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959349:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959354:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959360:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959367:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959373:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959378:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959384:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959393:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959399:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959405:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959410:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959415:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959421:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959427:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772199.959447:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790772199.960998:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790772199.961014:0:13245:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1790772199.961021:0:13245:0:(genops.c:885:class_export_put()) final put ffff8df27c043000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1790772199.961027:0:13245:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27c043000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1790772199.961033:0:13245:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1790772199.961094:0:13245:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df273e99800 1 00000020:00000080:2.0:1790772199.961101:0:13245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdf68d9a7d6a8fd47 00000020:00000080:2.0:1790772199.961109:0:13245:0:(genops.c:885:class_export_put()) final put ffff8df248b95000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1790772199.961125:0:13245:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1790772199.961139:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df248b95000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790772199.961153:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790772199.961168:0:13245:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790772199.961172:0:13245:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8df2581ccd40) has no exports 00000020:00000080:0.0:1790772199.991790:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772199.991814:0:13245:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1790772199.991821:0:13245:0:(genops.c:885:class_export_put()) final put ffff8df273e9c000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1790772199.991827:0:13245:0:(genops.c:844:class_export_destroy()) destroying export ffff8df273e9c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1790772199.991835:0:13245:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1790772199.992087:0:13245:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df273e9d000 00000020:01000000:0.0:1790772199.992127:0:13245:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1790772199.992133:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790772199.992139:0:13245:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790772199.992144:0:13245:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8df258e03380) has no exports 00000020:00000080:0.0:1790772199.992185:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790772199.992192:0:13245:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1790772199.992195:0:13245:0:(genops.c:885:class_export_put()) final put ffff8df2437ed800/OSS_uuid 00000020:00000080:0.0:1790772199.992198:0:13245:0:(genops.c:844:class_export_destroy()) destroying export ffff8df2437ed800/OSS_uuid for OSS 00000020:01000000:0.0:1790772199.992207:0:13245:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1790772199.992839:0:8509:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff8df27b0f2400:8509] 3 exiting: rc = 0 00000100:00100000:3.0:1790772199.994260:0:6678:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff8df243157200:6678] 1 exiting: rc = 0 00000100:00080000:2.0:1790772200.001487:0:5819:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790772200.002762:0:6679:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff8df243156600:6679] 2 exiting: rc = 0 00000100:00100000:2.0:1790772200.002857:0:6677:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff8df243156a00:6677] 0 exiting: rc = 1 00000100:00100000:0.0:1790772200.002915:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002927:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002934:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002944:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002950:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002955:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002961:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002967:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002972:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002977:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002993:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.002998:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003003:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003009:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003014:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003019:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003023:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003028:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003032:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003036:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003041:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003045:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003051:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003056:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003061:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003066:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003071:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003076:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003080:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003085:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003089:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003094:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003099:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003103:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003107:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003112:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003117:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003122:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003127:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003146:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003152:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003156:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003162:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003167:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003172:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003182:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003187:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003192:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003197:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003201:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003206:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003210:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003215:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003220:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003226:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003233:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003241:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003248:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003253:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003258:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003263:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003267:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003272:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.003277:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.004232:0:6680:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8df248a89800:6680] 0 exiting: rc = 1 00000100:00100000:0.0:1790772200.004331:0:6681:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8df248a89000:6681] 1 exiting: rc = 0 00000100:00100000:0.0:1790772200.004378:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004386:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004391:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004396:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004401:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004405:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004411:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004416:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004421:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004425:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004440:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004445:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004450:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004454:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004460:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004481:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004486:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004491:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004497:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004503:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004508:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004514:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004520:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004525:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004530:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004536:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.004541:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005003:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005013:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005018:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005024:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005029:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005034:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005039:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005044:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005049:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005053:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005058:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005065:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005069:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005074:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005082:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005087:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005092:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005096:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005101:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005106:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005111:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005115:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005120:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005132:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005137:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005142:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005147:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005152:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005157:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005161:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005166:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005170:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005175:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005180:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005184:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005189:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.005194:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006217:0:6683:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8df24922a800:6683] 1 exiting: rc = 0 00000100:00100000:0.0:1790772200.006444:0:6684:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8df27af50600:6684] 2 exiting: rc = 0 00000100:00100000:0.0:1790772200.006798:0:6682:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8df248a88c00:6682] 0 exiting: rc = 1 00000100:00100000:2.0:1790772200.006924:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006932:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006938:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006944:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006950:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006956:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006962:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006968:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006973:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006979:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006984:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006989:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006994:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.006999:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007006:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007011:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007017:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007022:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007027:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007033:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007047:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007053:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007058:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007063:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007069:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007074:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007079:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007099:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007105:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007110:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007116:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007122:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007127:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007133:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007139:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007145:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007150:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007155:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007160:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007166:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007172:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007177:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007182:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007188:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007193:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007199:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007215:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007222:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007229:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007234:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007240:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007246:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007251:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007257:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007262:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007267:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007273:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007278:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007284:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007290:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007295:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007300:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007311:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.007317:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.013782:0:6685:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8df27af50c00:6685] 0 exiting: rc = 1 00000100:00100000:1.0:1790772200.013838:0:6686:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8df27af50200:6686] 1 exiting: rc = 0 00000100:00100000:2.0:1790772200.013985:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014001:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014009:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014017:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014024:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014030:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014036:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014043:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014049:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014056:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014061:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014067:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014072:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014078:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014084:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014098:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014105:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014111:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014117:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014122:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014128:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014134:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014140:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014146:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014152:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014159:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014165:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014171:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014177:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014182:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014189:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014195:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014201:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014222:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014228:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014234:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014240:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014246:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014251:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014258:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014267:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014273:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014280:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014287:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014293:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014300:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014306:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014313:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014319:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014325:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014332:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014338:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014344:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014350:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014367:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014380:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014391:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014399:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014407:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014419:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014427:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014461:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014475:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.014482:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790772200.015467:0:6687:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8df248ae3800:6687] 0 exiting: rc = 1 00000100:00100000:1.0:1790772200.015680:0:6688:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8df248ae2c00:6688] 1 exiting: rc = 0 00000100:00100000:2.0:1790772200.015899:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.015910:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.015927:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.015936:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016399:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016408:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016416:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016424:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016442:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016452:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016460:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016483:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016492:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016500:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016509:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016516:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016522:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016529:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016535:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016541:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016577:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016587:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016594:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016615:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016623:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016631:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016639:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016646:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016652:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016658:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016666:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016672:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016680:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016688:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.016695:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.017998:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018017:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018024:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018032:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018060:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018067:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018075:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018083:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018089:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018096:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018102:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018110:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018839:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018857:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018864:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.018871:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019302:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019310:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019316:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019323:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019338:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019348:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019357:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019364:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019391:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019399:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019405:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019835:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790772200.019846:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790772200.057381:0:13245:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1790772220.874881:0:13869:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790772233.395144:0:14329:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790772233.395150:0:14329:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1790772233.395292:0:14329:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df27f91f800 00000020:01000004:0.0:1790772233.395315:0:14329:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1790772233.395325:0:14329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790772233.395344:0:14329:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8df2581ccd40) 00000020:00000080:0.0:1790772233.395361:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790772233.446926:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790772233.449970:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1790772233.453806:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 379: rc = 0 00100000:10000000:2.0:1790772233.454016:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790772233.454095:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 379: rc = 0 00100000:10000000:2.0:1790772233.454217:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 379: rc = 0 00100000:10000000:2.0:1790772233.454326:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 379: rc = 0 00100000:10000000:2.0:1790772233.454420:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 379: rc = 0 00100000:10000000:2.0:1790772233.458984:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 379: rc = 0 00100000:10000000:2.0:1790772233.459540:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 381: rc = 0 00100000:10000000:2.0:1790772233.462867:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:2.0:1790772233.462981:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:2.0:1790772233.466594:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1790772233.467231:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:2.0:1790772233.467519:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 773: rc = 0 00100000:10000000:2.0:1790772233.467938:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:2.0:1790772233.468185:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1790772233.468451:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1790772233.468771:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1790772233.469006:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1790772233.469236:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 773: rc = 0 00100000:10000000:2.0:1790772233.471500:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:2.0:1790772233.472114:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 773: rc = 0 00100000:10000000:2.0:1790772233.472690:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1790772233.473143:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 662: rc = 0 00100000:10000000:2.0:1790772233.473416:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 662: rc = 0 00100000:10000000:2.0:1790772233.474234:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 662: rc = 0 00100000:10000000:2.0:1790772233.474600:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 662: rc = 0 00100000:10000000:2.0:1790772233.475793:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 662: rc = 0 00100000:10000000:2.0:1790772233.476077:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 662: rc = 0 00100000:10000000:2.0:1790772233.476936:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 662: rc = 0 00100000:10000000:2.0:1790772233.479844:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 662: rc = 0 00100000:10000000:2.0:1790772233.480323:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 662: rc = 0 00100000:10000000:2.0:1790772233.480790:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 662: rc = 0 00100000:10000000:2.0:1790772233.481039:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 662: rc = 0 00100000:10000000:3.0:1790772233.481803:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 662: rc = 0 00100000:10000000:3.0:1790772233.483831:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 662: rc = 0 00100000:10000000:3.0:1790772233.484125:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 662: rc = 0 00100000:10000000:3.0:1790772233.485945:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 662: rc = 0 00100000:10000000:3.0:1790772233.486605:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 662: rc = 0 00100000:10000000:3.0:1790772233.486843:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 662: rc = 0 00100000:10000000:3.0:1790772233.487185:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 662: rc = 0 00100000:10000000:3.0:1790772233.487621:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 662: rc = 0 00100000:10000000:3.0:1790772233.487863:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 662: rc = 0 00100000:10000000:3.0:1790772233.488173:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 662: rc = 0 00100000:10000000:3.0:1790772233.488602:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 662: rc = 0 00100000:10000000:3.0:1790772233.488863:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 662: rc = 0 00100000:10000000:3.0:1790772233.489168:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 662: rc = 0 00100000:10000000:3.0:1790772233.489545:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 662: rc = 0 00100000:10000000:3.0:1790772233.489808:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 662: rc = 0 00100000:10000000:3.0:1790772233.490118:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 662: rc = 0 00100000:10000000:3.0:1790772233.490499:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 662: rc = 0 00100000:10000000:3.0:1790772233.492460:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 662: rc = 0 00100000:10000000:3.0:1790772233.492764:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 662: rc = 0 00100000:10000000:3.0:1790772233.493130:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 662: rc = 0 00100000:10000000:3.0:1790772233.493605:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 662: rc = 0 00100000:10000000:3.0:1790772233.493954:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 651: rc = 0 00100000:10000000:3.0:1790772233.494745:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1790772233.494901:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:3.0:1790772233.495163:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1790772233.495235:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:3.0:1790772233.495726:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1790772233.495790:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:3.0:1790772233.496639:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1790772233.496704:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 429: rc = 0 00100000:10000000:3.0:1790772233.496902:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1790772233.496973:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 429: rc = 0 00100000:10000000:3.0:1790772233.497243:0:14329:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1790772233.503574:0:14329:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 429: rc = 0 00000020:00000080:3.0:1790772233.503916:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790772233.503924:0:14329:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790772233.503936:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a90e5e 00000020:01000004:3.0:1790772233.503945:0:14329:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790772233.503951:0:14329:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790772233.503956:0:14329:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df27f91f800 from MGS 00000020:01000004:3.0:1790772233.503961:0:14329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790772233.503971:0:14329:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8df248b399c0) 00000020:00000080:3.0:1790772233.503982:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790772233.504164:0:14329:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df27f91f800 from MGS, refs=2 00080000:01000000:3.0:1790772233.504170:0:14329:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790772233.504175:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a90e6c 00000100:00100000:3.0:1790772233.504290:0:14329:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790772233.504648:0:14329:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790772233.504657:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790772233.507745:0:14329:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790772233.507759:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790772233.508735:0:14329:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772233.508978:0:14329:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790772233.508984:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790772233.509800:0:14329:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790772233.509810:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790772233.510220:0:14329:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790772233.510226:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790772233.511028:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772233.511032:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772233.511034:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772233.511287:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772233.511289:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772233.511291:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772233.512135:0:14329:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790772233.520595:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790772233.525089:0:14329:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790772233.525113:0:14329:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790772233.525116:0:14329:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790772233.527158:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790772233.527331:0:14329:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790772233.527461:0:14329:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790772233.528209:0:14329:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790772233.532293:0:14329:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772233.532925:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790772233.532933:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790772233.534246:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790772233.534266:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790772233.535992:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790772233.536005:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790772233.537076:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790772233.537102:0:14329:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.127@tcp' 00000020:01000004:0.0:1790772233.537104:0:14329:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790772233.537139:0:14329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.127@tcp (typ=mgc) 00000020:00000080:0.0:1790772233.537155:0:14329:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.127@tcp (ffff8df2581c99c0) 00000020:00000080:0.0:1790772233.537174:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790772233.537270:0:14329:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df27f91a000@MGC192.168.206.127@tcp: add connection 192.168.206.127@tcp at head 00010000:00010000:0.0:1790772233.537457:0:14329:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.127@tcp-0 is initialized 00000040:01000000:0.0:1790772233.537464:0:14329:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790772233.537748:0:14343:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1790772233.541365:0:14344:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790772233.541523:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.127@tcp (uuid f131dbd3-adf7-4830-81da-ffe0e188139b) 00000020:00000080:0.0:1790772233.541584:0:14329:0:(genops.c:1384:class_connect()) connect: client f131dbd3-adf7-4830-81da-ffe0e188139b, cookie 0xdf68d9a7d6a90e7a 00000100:00080000:0.0:1790772233.541600:0:14329:0:(import.c:545:import_select_connection()) MGC192.168.206.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790772233.541767:0:14329:0:(import.c:666:import_select_connection()) MGC192.168.206.127@tcp: import ffff8df27f91a000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1790772233.541811:0:14329:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27ae0df80 x1877760428558976/t0(0) o250->MGC192.168.206.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772233.541862:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f131dbd3-adf7-4830-81da-ffe0e188139b:3292:1877760428558976:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790772233.541946:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790772233.542021:0:14329:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f131dbd3-adf7-4830-81da-ffe0e188139b->MGS 00000020:01000004:0.0:1790772233.542042:0:14329:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790772233.542047:0:14329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790772233.542063:0:14329:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8df2581cb380) 00000020:00000080:0.0:1790772233.542076:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790772233.542513:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428558976 00000100:00100000:3.0:1790772233.542523:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428558976 00000100:00100000:3.0:1790772233.542597:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790772233.542606:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26e571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3292:x1877760428558976:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1790772233.542707:0:14340:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f131dbd3-adf7-4830-81da-ffe0e188139b@0@lo t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:3.0:1790772233.542734:0:14340:0:(genops.c:1384:class_connect()) connect: client f131dbd3-adf7-4830-81da-ffe0e188139b, cookie 0xdf68d9a7d6a90e88 00000100:00080000:3.0:1790772233.542877:0:14340:0:(import.c:65:import_set_state_nolock()) ffff8df27abc7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772233.542950:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26e571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+5:3292:x1877760428558976:12345-0@lo:250:mount.lustre.0 Request processed in 344us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772233.542958:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772233.544886:0:3292:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790772233.544905:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.127@tcp: connect to target with instance 0 00000100:00080000:0.0:1790772233.544914:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790772233.544920:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790772233.544924:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df27f91a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790772233.544928:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790772233.544946:0:3292:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790772233.544954:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f131dbd3-adf7-4830-81da-ffe0e188139b:3292:1877760428558976:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790772233.599159:0:14329:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772233.599428:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790772233.599435:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790772233.601040:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790772233.601052:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790772233.601525:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790772233.601543:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790772233.603331:0:14329:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772233.603621:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790772233.603628:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790772233.604889:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790772233.604900:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790772233.725305:0:14329:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772233.725604:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790772233.725611:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790772233.732956:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790772233.732969:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790772233.733878:0:14329:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772233.734095:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790772233.734101:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790772233.735183:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790772233.735193:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790772233.736253:0:14329:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772233.739702:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790772233.739732:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790772233.751825:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790772233.751869:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790772233.753650:0:14329:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772233.754213:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790772233.754220:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790772233.761041:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790772233.761060:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790772233.846871:0:14329:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772233.847508:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790772233.847630:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790772233.852890:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790772233.852916:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1790772233.861770:0:14329:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790772233.861785:0:14329:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790772233.865827:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790772233.865852:0:14329:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790772233.865857:0:14329:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790772233.865979:0:14329:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790772233.866011:0:14329:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.127@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790772233.866015:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790772233.866017:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790772233.866018:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772233.866019:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772233.866021:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772233.866022:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772233.866024:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772233.866025:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790772233.866027:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772233.866028:0:14329:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790772233.866031:0:14329:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790772233.866033:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790772233.866034:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790772233.866035:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772233.866036:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772233.866037:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772233.866038:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772233.866039:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772233.866040:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790772233.866041:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772233.866042:0:14329:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790772233.866064:0:14329:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790772233.866082:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559104:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790772233.866170:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772233.866335:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244233840 going to sleep for 11 seconds 00000100:00100000:1.0:1790772233.866423:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428559104 00000100:00100000:1.0:1790772233.866431:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428559104 00000100:00100000:1.0:1790772233.866542:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772233.866566:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26e572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+5:14329:x1877760428559104:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790772233.866602:0:14342:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790772233.866604:0:14342:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790772233.866607:0:14342:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790772233.867116:0:14362:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790772233.867525:0:14342:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1790772233.874770:0:14363:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790772233.874784:0:14363:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790772233.874787:0:14363:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1790772233.874825:0:14363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1790772233.875268:0:14342:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790772233.875327:0:14342:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790772233.883497:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26e572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+5:14329:x1877760428559104:12345-0@lo:253:mount.lustre.0 Request processed in 16941us (17322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772233.883514:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790772233.883746:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559104:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790772233.883761:0:14329:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790772233.883764:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790772233.883765:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790772233.883766:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772233.883768:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772233.883769:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772233.883771:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772233.883772:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772233.883773:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790772233.883775:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772233.883776:0:14329:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790772233.883793:0:14329:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df27f91f800 from lustre-MDT0000 10000000:01000000:3.0:1790772233.883814:0:14329:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790772233.883817:0:14329:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790772233.883821:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8df2581c99c0 10000000:01000000:3.0:1790772233.883824:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772233.883831:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df2581c99c0 from 1 10000000:01000000:3.0:1790772233.883834:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790772233.883864:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772233.883875:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772233.883884:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772233.883901:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772233.883931:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772233.883978:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244233a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772233.884043:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428559232 00000100:00100000:0.0:1790772233.884049:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428559232 00000100:00100000:0.0:1790772233.884083:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772233.884091:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26e572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+5:14329:x1877760428559232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772233.884102:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772233.884114:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a90e96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90e8f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772233.884134:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a90e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90e8f expref: 6 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772233.884144:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031e00/0xdf68d9a7d6a90e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90e8f expref: 6 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772233.884152:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031e00, rc 0) 00000100:00100000:0.0:1790772233.884191:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26e572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+6:14329:x1877760428559232:12345-0@lo:101:mount.lustre.0 Request processed in 101us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772233.884197:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772233.884915:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772233.884930:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90e96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772233.884940:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90e96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772233.885000:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772233.885031:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772233.885060:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df248bef180 going to sleep for 11 seconds 00000100:00100000:2.0:1790772233.885100:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428559360 00000100:00100000:2.0:1790772233.885105:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428559360 00000100:00100000:2.0:1790772233.885135:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772233.885142:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+6:14329:x1877760428559360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772233.885758:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+6:14329:x1877760428559360:12345-0@lo:501:mount.lustre.0 Request processed in 615us (726us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790772233.885766:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772233.885888:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559360:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790772233.885911:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790772233.886302:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90e96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772233.886313:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90e96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772233.886332:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df27f91f800 10000000:01000000:1.0:1790772233.886336:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790772233.886340:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df27f91f800 10000000:01000000:1.0:1790772233.886343:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790772233.886346:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df27f91f800 from 1 10000000:01000000:1.0:1790772233.886348:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790772233.886369:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9e00/0xdf68d9a7d6a90e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772233.886377:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9e00/0xdf68d9a7d6a90e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772233.886386:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9e00/0xdf68d9a7d6a90e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772233.886399:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772233.886425:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772233.886482:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df248bef180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772233.891000:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428559488 00000100:00100000:3.0:1790772233.891011:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428559488 00000100:00100000:3.0:1790772233.891351:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790772233.891361:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+6:14329:x1877760428559488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772233.891375:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772233.891396:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241327c00/0xdf68d9a7d6a90ea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90e9d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772233.891417:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241327c00/0xdf68d9a7d6a90ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90e9d expref: 7 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772233.891428:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241327c00/0xdf68d9a7d6a90ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90e9d expref: 7 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772233.891436:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241327c00, rc 0) 00000100:00100000:3.0:1790772233.891592:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+7:14329:x1877760428559488:12345-0@lo:101:mount.lustre.0 Request processed in 232us (5165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772233.891599:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772233.899129:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772233.899155:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9e00/0xdf68d9a7d6a90e9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90ea4 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772233.899168:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9e00/0xdf68d9a7d6a90e9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90ea4 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772233.899185:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790772233.899251:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9e00/0xdf68d9a7d6a90e9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90ea4 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772233.899282:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9e00/0xdf68d9a7d6a90e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90ea4 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772233.899290:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790772233.899295:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790772233.899300:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df27f91f800 10000000:01000000:1.0:1790772233.899303:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790772233.899307:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790772233.899309:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790772233.899347:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a90eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772233.899355:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a90eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772233.899365:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a90eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772233.899382:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772233.899430:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772233.899467:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df248bef180 going to sleep for 11 seconds 00000100:00100000:2.0:1790772233.899729:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428559616 00000100:00100000:2.0:1790772233.899735:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428559616 00000100:00100000:2.0:1790772233.899780:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772233.899794:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+7:14329:x1877760428559616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772233.899806:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772233.899818:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9ab000/0xdf68d9a7d6a90eb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90eab expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772233.899835:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9ab000/0xdf68d9a7d6a90eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90eab expref: 8 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772233.899844:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9ab000/0xdf68d9a7d6a90eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90eab expref: 8 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772233.899852:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab000, rc 0) 00000100:00100000:2.0:1790772233.899892:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+8:14329:x1877760428559616:12345-0@lo:101:mount.lustre.0 Request processed in 100us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772233.899899:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790772233.900017:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772233.900037:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a90eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90eb2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772233.900045:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a90eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90eb2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772233.900191:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772233.900217:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772233.900309:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df248bef180 going to sleep for 11 seconds 00000100:00100000:2.0:1790772233.900546:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428559744 00000100:00100000:2.0:1790772233.900575:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428559744 00000100:00100000:2.0:1790772233.900595:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772233.900601:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+8:14329:x1877760428559744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772233.900906:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+9:14329:x1877760428559744:12345-0@lo:501:mount.lustre.0 Request processed in 304us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772233.900913:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790772233.900997:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772233.901035:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559872:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772233.901070:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772233.901099:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244233a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772233.901521:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428559872 00000100:00100000:2.0:1790772233.901534:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428559872 00000100:00100000:2.0:1790772233.901716:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772233.901724:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+9:14329:x1877760428559872:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772233.901977:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+9:14329:x1877760428559872:12345-0@lo:503:mount.lustre.0 Request processed in 253us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772233.901991:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790772233.917066:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428559872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772233.922587:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14364:1877760428560000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772233.922656:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772233.922696:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df248befcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772233.922750:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428560000 00000100:00100000:3.0:1790772233.922757:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428560000 00000100:00100000:3.0:1790772233.922797:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790772233.922805:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+9:14364:x1877760428560000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772233.923109:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+9:14364:x1877760428560000:12345-0@lo:502:llog_process_th.0 Request processed in 303us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772233.923117:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790772233.923351:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14364:1877760428560000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790772233.923385:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772233.923394:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772233.923396:0:14364:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790772233.923401:0:14364:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790772233.923403:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790772233.923415:0:14364:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8df2581c8000) 00000020:00000080:0.0:1790772233.923431:0:14364:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790772233.923436:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790772233.923491:0:14364:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790772233.923498:0:14364:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a90ec0 00000020:00000080:0.0:1790772233.923695:0:14364:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790772233.923699:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790772233.923702:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772233.923703:0:14364:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790772233.923706:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790772233.923709:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790772233.923710:0:14364:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790772233.923713:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790772233.923720:0:14364:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8df258e03380) 00000020:00000080:0.0:1790772233.923729:0:14364:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790772233.923732:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790772233.923734:0:14364:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790772233.923736:0:14364:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790772233.923741:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790772233.923771:0:14364:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df27f91f800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790772233.923780:0:14364:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8df258e04d40) 00000020:00000080:0.0:1790772233.923789:0:14364:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790772233.923833:0:14364:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790772233.923840:0:14364:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf68d9a7d6a90ed5 00000020:00000080:0.0:1790772233.923933:0:14364:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790772233.923938:0:14364:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790772233.923942:0:14364:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdf68d9a7d6a90edc 00080000:01000000:0.0:1790772233.923950:0:14364:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790772233.923953:0:14364:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a90ee3 00010000:00010000:2.0:1790772234.058934:0:14364:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790772234.059324:0:14364:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1790772234.059482:0:14364:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790772234.060247:0:14364:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8df27fad3380) 00000020:00000080:2.0:1790772234.060271:0:14364:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790772234.060451:0:14364:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790772234.060460:0:14364:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a90ef1 00000020:00000080:2.0:1790772234.062988:0:14364:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790772234.083454:0:14364:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdf68d9a7d6a90ef8 00000020:00000080:2.0:1790772234.084650:0:14364:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790772234.084662:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772234.084668:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.084670:0:14364:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790772234.084673:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790772234.084676:0:14364:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1790772234.084677:0:14364:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790772234.084679:0:14364:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790772234.084680:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790772234.084683:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.084684:0:14364:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790772234.084686:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772234.084691:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.084692:0:14364:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790772234.084696:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790772234.084727:0:14364:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790772234.084738:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772234.084740:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.084741:0:14364:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790772234.084744:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790772234.084747:0:14364:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790772234.084755:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.084757:0:14364:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790772234.084760:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790772234.084765:0:14364:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.127@tcp to nid 0x20000c0a8ce7f (192.168.206.127@tcp) 00000020:01000000:2.0:1790772234.084785:0:14364:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790772234.084788:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790772234.084800:0:14364:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8df27fad4d40) 00000020:00000080:2.0:1790772234.084812:0:14364:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1790772234.084817:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790772234.084871:0:14364:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790772234.084876:0:14364:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790772234.084881:0:14364:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a90f06 00010000:00080000:2.0:1790772234.084907:0:14364:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df26fb2a800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:2.0:1790772234.085119:0:14364:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1790772234.090236:0:14364:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790772234.090296:0:14364:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790772234.093717:0:14364:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772234.093949:0:14364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1790772234.094081:0:14364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1790772234.099622:0:14368:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790772234.099629:0:14368:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790772234.100764:0:14364:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772234.100775:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790772234.100806:0:14364:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790772234.100822:0:14364:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf68d9a7d6a90f0d 00000100:00080000:1.0:1790772234.100831:0:14364:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772234.100841:0:14364:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df26fb2a800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1790772234.100871:0:14364:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df26f3e8000 x1877760428560128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772234.100896:0:14364:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790772234.100954:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772234.100958:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772234.100960:0:14364:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790772234.100963:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790772234.100966:0:14364:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1790772234.100967:0:14364:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772234.100969:0:14364:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790772234.100970:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790772234.100973:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772234.100975:0:14364:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790772234.100982:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790772234.100986:0:14364:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790772234.100989:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772234.100991:0:14364:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790772234.100993:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790772234.100997:0:14364:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.127@tcp to nid 0x20000c0a8ce7f (192.168.206.127@tcp) 00000020:01000000:1.0:1790772234.101014:0:14364:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790772234.101016:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790772234.101037:0:14364:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8df259070000) 00000020:00000080:1.0:1790772234.101047:0:14364:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790772234.101052:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790772234.101102:0:14364:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790772234.101108:0:14364:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790772234.101112:0:14364:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf68d9a7d6a90f1b 00010000:00080000:1.0:1790772234.101135:0:14364:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df245b7f000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.127@tcp at head 00000100:00100000:0.0:1790772234.101567:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428560128:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790772234.101612:0:3292:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760428560128 offset 0 length 520: 4 00010000:00010000:1.0:1790772234.101808:0:14364:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1790772234.101965:0:14364:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790772234.101983:0:14364:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790772234.105172:0:14364:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772234.105396:0:14364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1790772234.105469:0:14364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1790772234.111077:0:14370:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790772234.111085:0:14370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790772234.113106:0:14364:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790772234.113119:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790772234.113151:0:14364:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790772234.113170:0:14364:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf68d9a7d6a90f22 00000100:00080000:1.0:1790772234.113180:0:14364:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790772234.113190:0:14364:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df245b7f000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1790772234.113224:0:14364:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df26f3e9880 x1877760428560256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790772234.113263:0:14364:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1790772234.113545:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428560256:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790772234.113632:0:3292:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760428560256 offset 0 length 520: 4 00000020:01000000:1.0:1790772234.113971:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772234.113975:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772234.113977:0:14364:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790772234.113980:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772234.113983:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772234.113984:0:14364:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790772234.113987:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790772234.113988:0:14364:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790772234.113991:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772234.113993:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772234.113994:0:14364:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790772234.113996:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772234.113998:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772234.113999:0:14364:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790772234.114003:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790772234.114040:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14364:1877760428560384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790772234.114089:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772234.114159:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df248befcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772234.120178:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428560384 00000100:00100000:0.0:1790772234.120190:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428560384 00000100:00100000:0.0:1790772234.120251:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772234.120269:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+9:14364:x1877760428560384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790772234.120707:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+9:14364:x1877760428560384:12345-0@lo:502:llog_process_th.0 Request processed in 438us (6616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772234.120715:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772234.120810:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14364:1877760428560384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772234.120840:0:14364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772234.120846:0:14364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.120848:0:14364:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790772234.120852:0:14364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790772234.121336:0:14329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1790772234.121355:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790772234.121376:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a90eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90eb2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.121388:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8a00/0xdf68d9a7d6a90eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90eb2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772234.121396:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df27f91f800 from 1 10000000:01000000:0.0:1790772234.121399:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790772234.121428:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.121436:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.121455:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772234.121474:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428560512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790772234.121507:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772234.121694:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772234.121767:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428560512 00000100:00100000:2.0:1790772234.121772:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428560512 00000100:00100000:2.0:1790772234.121802:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772234.121809:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+9:14329:x1877760428560512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772234.121827:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772234.121838:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a90f30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90f29 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772234.121858:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a90f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f29 expref: 10 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772234.121868:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a90f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f29 expref: 10 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772234.121876:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa600, rc 0) 00000100:00100000:2.0:1790772234.121906:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+10:14329:x1877760428560512:12345-0@lo:101:mount.lustre.0 Request processed in 98us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772234.121912:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790772234.122113:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428560512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772234.122125:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.122133:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772234.122981:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428560640:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790772234.123017:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772234.123197:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098000 going to sleep for 11 seconds 00000100:00100000:1.0:1790772234.127453:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428560640 00000100:00100000:1.0:1790772234.127466:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428560640 00000100:00100000:1.0:1790772234.127516:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772234.127524:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+10:14329:x1877760428560640:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790772234.127575:0:14342:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790772234.127581:0:14342:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790772234.127674:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+10:14329:x1877760428560640:12345-0@lo:256:mount.lustre.0 Request processed in 150us (4655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772234.127682:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790772234.128343:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428560640:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790772234.129137:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790772234.129158:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.129169:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772234.129178:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df27f91f800 from 1 10000000:01000000:0.0:1790772234.129180:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772234.129216:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.129224:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.129413:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772234.129433:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428560768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790772234.129471:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772234.129582:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098000 going to sleep for 11 seconds 00000100:00100000:2.0:1790772234.134340:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428560768 00000100:00100000:2.0:1790772234.134354:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428560768 00000100:00100000:0.0:1790772234.134795:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772234.134805:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+10:14329:x1877760428560768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790772234.134820:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772234.134837:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a90f3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90f37 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.134863:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a90f3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f37 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.134874:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a90f3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f37 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.134884:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031200, rc 0) 00000100:00100000:0.0:1790772234.134947:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14329:x1877760428560768:12345-0@lo:101:mount.lustre.0 Request processed in 144us (5475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772234.134953:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772234.135071:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428560768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772234.135087:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772234.135096:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772234.135156:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428560896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772234.135184:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772234.135220:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098000 going to sleep for 11 seconds 00000100:00100000:1.0:1790772234.135456:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428560896 00000100:00100000:1.0:1790772234.135461:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428560896 00000100:00100000:1.0:1790772234.135493:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790772234.135500:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14329:x1877760428560896:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772234.135849:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14329:x1877760428560896:12345-0@lo:501:mount.lustre.0 Request processed in 349us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772234.135857:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772234.136122:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428560896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772234.136148:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428561024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772234.136186:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772234.136202:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772234.137049:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428561024 00000100:00100000:0.0:1790772234.137061:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428561024 00000100:00100000:0.0:1790772234.138372:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790772234.138384:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14329:x1877760428561024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790772234.138873:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14329:x1877760428561024:12345-0@lo:503:mount.lustre.0 Request processed in 493us (2686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772234.138881:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790772234.138970:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428561024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772234.139587:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14372:1877760428561152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772234.139626:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772234.139728:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2820e76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772234.142492:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428561152 00000100:00100000:3.0:1790772234.142503:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428561152 00000100:00100000:3.0:1790772234.143223:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772234.143244:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14372:x1877760428561152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772234.143661:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14372:1877760428561152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772234.143692:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772234.143700:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.143702:0:14372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790772234.143708:0:14372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df27f91f800 00000020:00000080:2.0:1790772234.143710:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772234.143716:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772234.143718:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.143720:0:14372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790772234.143722:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772234.143724:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.143725:0:14372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790772234.143728:0:14372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df27f91f800 00000020:00000080:2.0:1790772234.143730:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790772234.143775:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772234.143777:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.143779:0:14372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790772234.143781:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772234.143784:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.143785:0:14372:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790772234.143788:0:14372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df27f91f800 00000020:00000080:2.0:1790772234.143789:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790772234.143826:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14372:1877760428561280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772234.143869:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772234.143895:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df254098000 going to sleep for 11 seconds 00000100:00100000:3.0:1790772234.143991:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14372:x1877760428561152:12345-0@lo:502:llog_process_th.0 Request processed in 297us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772234.144002:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772234.144029:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428561280 00000100:00100000:3.0:1790772234.144033:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428561280 00000100:00100000:3.0:1790772234.144049:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772234.144054:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14372:x1877760428561280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790772234.147568:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14372:x1877760428561280:12345-0@lo:502:llog_process_th.0 Request processed in 3507us (3692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772234.147580:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790772234.151280:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14372:1877760428561280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790772234.151651:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772234.151660:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772234.151662:0:14372:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790772234.151667:0:14372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790772234.151808:0:14329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790772234.151826:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772234.151848:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772234.151860:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772234.151902:0:14329:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790772234.151904:0:14329:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df27f91f800 10000000:01000000:3.0:1790772234.151913:0:14329:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df27f91f800 10000000:01000000:3.0:1790772234.151916:0:14329:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772234.151921:0:14329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df27f91f800 from 1 10000000:01000000:3.0:1790772234.151924:0:14329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790772234.151951:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241327a00/0xdf68d9a7d6a90f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772234.151959:0:14329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241327a00/0xdf68d9a7d6a90f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772234.151969:0:14329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241327a00/0xdf68d9a7d6a90f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772234.151986:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428561408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772234.152048:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772234.152082:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092840 going to sleep for 11 seconds 00000100:00100000:2.0:1790772234.152735:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428561408 00000100:00100000:2.0:1790772234.152742:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428561408 00000100:00100000:2.0:1790772234.152786:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790772234.152794:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14329:x1877760428561408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772234.152806:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772234.152818:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9aac00/0xdf68d9a7d6a90f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90f45 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772234.152838:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9aac00/0xdf68d9a7d6a90f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f45 expref: 12 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772234.152847:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9aac00/0xdf68d9a7d6a90f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f45 expref: 12 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772234.152855:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aac00, rc 0) 00000100:00100000:2.0:1790772234.152895:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14329:x1877760428561408:12345-0@lo:101:mount.lustre.0 Request processed in 102us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772234.152902:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772234.153064:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428561408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772234.153079:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241327a00/0xdf68d9a7d6a90f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f4c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772234.153089:0:14329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241327a00/0xdf68d9a7d6a90f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90f4c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772234.153134:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428561536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772234.153160:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772234.153189:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772234.153204:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428561536 00000100:00100000:3.0:1790772234.153207:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428561536 00000100:00100000:2.0:1790772234.153442:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790772234.153451:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14329:x1877760428561536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772234.169822:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14329:x1877760428561536:12345-0@lo:501:mount.lustre.0 Request processed in 16364us (16652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772234.169842:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790772234.174834:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428561536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772234.174900:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428561664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772234.174961:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772234.174994:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df259092840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772234.175015:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428561664 00000100:00100000:3.0:1790772234.176737:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428561664 00000100:00100000:3.0:1790772234.176791:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790772234.176799:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14329:x1877760428561664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772234.176986:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14329:x1877760428561664:12345-0@lo:503:mount.lustre.0 Request processed in 187us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772234.176994:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790772234.178348:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428561664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772234.191778:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14377:1877760428561792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772234.191845:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772234.191879:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428561792 00000100:00100000:2.0:1790772234.191884:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428561792 00000100:00100000:2.0:1790772234.191915:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790772234.191923:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14377:x1877760428561792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772234.192130:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14377:x1877760428561792:12345-0@lo:502:llog_process_th.0 Request processed in 207us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772234.192138:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790772234.192180:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790772234.192202:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14377:1877760428561792:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1790772234.192277:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790772234.192289:0:14377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8df27fad19c0) 00000020:00000080:2.0:1790772234.192306:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1790772234.192470:0:14377:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df27f91f800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790772234.192474:0:14377:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df27f91f800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790772234.192477:0:14377:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df27f91f800 4 00010000:00080000:2.0:1790772234.192501:0:14377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df27b07a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:2.0:1790772234.210239:0:14377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1790772234.230089:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790772234.230127:0:14377:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790772234.230137:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdf68d9a7d6a90f5a 00000100:00080000:2.0:1790772234.230146:0:14377:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790772234.230157:0:14377:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8df27b07a000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:2.0:1790772234.230185:0:14377:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27401d880 x1877760428561920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772234.230216:0:14377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790772234.230546:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877760428561920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790772234.230770:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772234.231062:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428561920 00000100:00100000:2.0:1790772234.231068:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428561920 00000100:00100000:2.0:1790772234.231108:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772234.231114:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1877760428561920:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790772234.231161:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1877760428561920:12345-0@lo:38:llog_process_th.0 Request processed in 46us (392us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790772234.231168:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772234.231226:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790772234.231242:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df27b07a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772234.231246:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790772234.231250:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877760428561920:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790772234.236646:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14377:1877760428562048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772234.236722:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772234.236757:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428562048 00000100:00100000:2.0:1790772234.236763:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428562048 00000100:00100000:2.0:1790772234.236797:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790772234.236804:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14377:x1877760428562048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790772234.237021:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14377:x1877760428562048:12345-0@lo:502:llog_process_th.0 Request processed in 217us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772234.237029:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790772234.237073:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1790772234.237096:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f131dbd3-adf7-4830-81da-ffe0e188139b:14377:1877760428562048:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790772234.237119:0:14377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790772234.238850:0:14329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790772234.238878:0:14329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790772234.238896:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241327a00/0xdf68d9a7d6a90f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f4c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772234.238907:0:14329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241327a00/0xdf68d9a7d6a90f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f4c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790772234.238962:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790772234.238964:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772234.238966:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772234.238967:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772234.238969:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772234.238970:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772234.238971:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772234.238973:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772234.238975:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772234.238976:0:14329:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790772234.238980:0:14329:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790772234.238982:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790772234.238984:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772234.238985:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772234.238986:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772234.238987:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772234.238988:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772234.238989:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772234.238990:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772234.238991:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772234.238993:0:14329:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790772234.239013:0:14329:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790772234.239041:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428562176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790772234.239087:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772234.239130:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2431bb240 going to sleep for 11 seconds 00000100:00100000:1.0:1790772234.239191:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428562176 00000100:00100000:1.0:1790772234.239198:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428562176 00000100:00100000:1.0:1790772234.239248:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772234.239267:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14329:x1877760428562176:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790772234.239303:0:14342:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790772234.239316:0:14342:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790772234.337365:0:14342:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790772234.337385:0:14342:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790772234.337823:0:14362:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790772234.337829:0:14362:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790772234.337853:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772234.337872:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a90f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f29 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772234.337881:0:14362:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772234.337918:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a90f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a90f29 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772234.337934:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a90f30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f29 expref: 12 pid: 14340 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772234.337947:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14362:1877760428562304:0@lo:104: 00000100:00100000:1.0:1790772234.338008:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772234.338074:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25913ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772234.338209:0:14330:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428562304 00000100:00100000:0.0:1790772234.338216:0:14330:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428562304 00000100:00100000:0.0:1790772234.338283:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772234.338293:0:14330:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f131dbd3-adf7-4830-81da-ffe0e188139b+3:14362:x1877760428562304:12345-0@lo:104: 00010000:00010000:0.0:1790772234.338305:0:14330:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338360:0:14330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790772234.338366:0:14330:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f131dbd3-adf7-4830-81da-ffe0e188139b+3:14362:x1877760428562304:12345-0@lo:104: Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772234.338374:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772234.338409:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14362:1877760428562304:0@lo:104: 00010000:00010000:0.0:1790772234.338426:0:14362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338449:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772234.338455:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338462:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031800 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1790772234.338466:0:14336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338475:0:14336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790772234.338483:0:14336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772234.338489:0:14336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790772234.338515:0:14336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338521:0:14336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790772234.338580:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338588:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df240031800/0xdf68d9a7d6a90f29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f30 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338603:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772234.338605:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772234.338607:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772234.338634:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f131dbd3-adf7-4830-81da-ffe0e188139b:3296:1877760428562432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772234.338669:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772234.338747:0:14332:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428562432 00000100:00100000:0.0:1790772234.338751:0:14332:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428562432 00010000:00010000:0.0:1790772234.338767:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a90f30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f29 expref: 13 pid: 14340 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772234.338790:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772234.338797:0:14332:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f131dbd3-adf7-4830-81da-ffe0e188139b+13:3296:x1877760428562432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772234.338808:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772234.338813:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a90f30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f29 expref: 13 pid: 14340 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338822:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a90f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f29 expref: 13 pid: 14340 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338834:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a90f30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f29 expref: 13 pid: 14340 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338846:0:14332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338853:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790772234.338865:0:14332:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001036317s 00010000:00010000:0.0:1790772234.338868:0:14332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338875:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338892:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338898:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338903:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772234.338907:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338915:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338928:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338936:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772234.338962:0:14332:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:3296:x1877760428562432:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772234.338968:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790772234.338986:0:14362:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338993:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772234.338999:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a90f61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772234.339291:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f131dbd3-adf7-4830-81da-ffe0e188139b:3296:1877760428562432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772234.392417:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14329:x1877760428562176:12345-0@lo:253:mount.lustre.0 Request processed in 153145us (153322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772234.392431:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790772234.392654:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:14329:1877760428562176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790772234.392669:0:14329:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790772234.392672:0:14329:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772234.392673:0:14329:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790772234.392675:0:14329:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772234.392676:0:14329:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772234.392677:0:14329:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772234.392679:0:14329:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772234.392680:0:14329:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790772234.392681:0:14329:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790772234.392694:0:14329:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772234.392696:0:14329:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790772234.392712:0:14329:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790772234.401291:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772234.402104:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790772234.402403:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772234.420066:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790772234.423083:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772234.423238:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1790772234.431523:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772234.431805:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1790772234.432419:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772234.432736:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790772234.432959:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790772234.433452:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:0.0:1790772234.533909:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790772234.550858:0:14329:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1790772234.555169:0:14329:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1790772234.555382:0:14385:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1790772234.555387:0:14385:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1790772234.555886:0:14386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1790772234.555981:0:14386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772234.569004:0:14386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:01000000:1.0:1790772234.570005:0:14329:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790772234.570120:0:14329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790772234.575228:0:14329:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790772234.575661:0:14329:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000004:00080000:0.0:1790772234.575817:0:14386:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790772234.575822:0:14386:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1790772234.576510:0:14329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772234.579962:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790772234.588273:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790772234.588505:0:14329:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1790772234.593652:0:14329:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1790772234.607713:0:14329:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790772234.656617:0:14329:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790772234.656651:0:14329:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa05941c83988 00100000:10000000:1.0:1790772234.656659:0:14329:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790772234.657811:0:14329:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790772234.657826:0:14329:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790772234.657840:0:14329:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1790772234.657854:0:14329:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1790772235.236694:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1790772235.426856:0:14344:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790772235.426863:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df27f91f800 from 6 10000000:01000000:2.0:1790772235.426868:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790772235.426917:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772235.426928:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772235.426939:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772235.426960:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428562560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772235.427013:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772235.427049:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df1420383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772235.427221:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428562560 00000100:00100000:3.0:1790772235.427229:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428562560 00000100:00100000:3.0:1790772235.427314:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790772235.427323:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14344:x1877760428562560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772235.427335:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772235.427348:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241326a00/0xdf68d9a7d6a90f6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90f68 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772235.427369:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241326a00/0xdf68d9a7d6a90f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f68 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772235.427379:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241326a00/0xdf68d9a7d6a90f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f68 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772235.427401:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241326a00, rc 0) 00000100:00100000:3.0:1790772235.427443:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14344:x1877760428562560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772235.427450:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790772235.428221:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428562560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772235.428257:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772235.428267:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772235.428319:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428562688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790772235.428353:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772235.428373:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df1420383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772235.429307:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428562688 00000100:00100000:1.0:1790772235.429315:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428562688 00000100:00100000:1.0:1790772235.429355:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772235.429363:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14344:x1877760428562688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790772235.429381:0:14342:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790772235.429397:0:14342:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790772235.429400:0:14342:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1790772235.429491:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14344:x1877760428562688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772235.429498:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790772235.429546:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428562688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790772235.429606:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790772235.429614:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772235.429622:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772235.556236:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772236.256922:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790772236.577173:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772237.600749:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772238.623728:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790772239.329171:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772239.329178:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790772239.329181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772239.329184:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790772239.329187:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790772239.329190:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790772239.329193:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df27b07a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790772239.329208:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8df27b07a000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1790772239.329240:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27f9c7b80 x1877760428562944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772239.329323:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428562816:0@lo:400:kworker.0 00000100:00100000:1.0:1790772239.329395:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772239.329564:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428562816 00000100:00100000:3.0:1790772239.329572:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428562816 00000100:00100000:3.0:1790772239.329631:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790772239.329640:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+12:3293:x1877760428562816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772239.329690:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+12:3293:x1877760428562816:12345-0@lo:400:kworker.0 Request processed in 51us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772239.329697:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790772239.329741:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428562816:0@lo:400:kworker.0 00000100:00100000:2.0:1790772239.330024:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877760428562944:0@lo:38:kworker.0 00000100:00100000:2.0:1790772239.330069:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772239.330154:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428562944 00000100:00100000:1.0:1790772239.330159:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428562944 00000100:00100000:1.0:1790772239.330186:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772239.330192:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1877760428562944:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790772239.330213:0:14348:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:1.0:1790772239.330258:0:14348:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdf68d9a7d6a90f76 00000004:00100000:1.0:1790772239.330271:0:14348:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790772239.330407:0:14348:0:(import.c:65:import_set_state_nolock()) ffff8df273f98800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772239.330457:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877760428562944:12345-0@lo:38:kworker.0 Request processed in 264us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772239.330464:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790772239.330637:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df27f9c7b80 x1877760428562944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790772239.330662:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790772239.330669:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790772239.330686:0:3292:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790772239.330688:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df27b07a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790772239.330694:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877760428562944:0@lo:38:kworker.0 00010000:00010000:0.0:1790772239.649246:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772239.752523:0:14629:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790772240.678395:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772241.696675:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772242.720930:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790772243.057862:0:14780:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffccb68070 20000000:00000080:0.0:1790772243.057878:0:14780:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df275f16800 uarg=0000000000000000 20000000:01000000:0.0:1790772243.057910:0:14780:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790772243.057917:0:14780:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790772243.057921:0:14780:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790772243.058812:0:14781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1790772243.058941:0:14780:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790772243.070748:0:14780:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790772243.070776:0:14780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.070794:0:14780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a90f3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f37 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.070819:0:14780:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.070858:0:14780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a90f3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a90f37 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.070873:0:14780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a90f3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f37 expref: 11 pid: 14341 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772243.070886:0:14780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14780:1877760428563072:0@lo:104: 00000100:00100000:0.0:1790772243.070943:0:14780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772243.071038:0:14780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df250bb0900 going to sleep for 11 seconds 00000100:00100000:1.0:1790772243.075401:0:14331:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428563072 00000100:00100000:1.0:1790772243.075413:0:14331:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428563072 00000100:00100000:1.0:1790772243.075462:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772243.075471:0:14331:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+3:14780:x1877760428563072:12345-0@lo:104: 00010000:00010000:1.0:1790772243.075496:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772243.075618:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772243.075625:0:14331:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+3:14780:x1877760428563072:12345-0@lo:104: Request processed in 155us (4682us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772243.075632:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790772243.075802:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772243.075809:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772243.075817:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030600 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:3.0:1790772243.075821:0:14336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772243.075830:0:14336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790772243.075838:0:14336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772243.075844:0:14336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790772243.075876:0:14336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772243.075883:0:14336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790772243.075913:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772243.075930:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df240030600/0xdf68d9a7d6a90f37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f3e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772243.075948:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772243.075950:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772243.075951:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772243.075959:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772243.075973:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428563200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772243.076008:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772243.076084:0:14332:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428563200 00000100:00100000:0.0:1790772243.076088:0:14332:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428563200 00010000:00010000:0.0:1790772243.076110:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a90f3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f37 expref: 12 pid: 14341 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772243.076138:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772243.076162:0:14332:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:3293:x1877760428563200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772243.076172:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772243.076178:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a90f3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f37 expref: 12 pid: 14341 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076188:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a90f3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f37 expref: 12 pid: 14341 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076204:0:14332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076232:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076246:0:14332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076253:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076260:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076267:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076271:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030e00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772243.076275:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076283:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076291:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.076301:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772243.076332:0:14332:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:3293:x1877760428563200:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772243.076339:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772243.076370:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428563200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772243.076668:0:14780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a90f3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f37 expref: 11 pid: 14341 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772243.076679:0:14780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14780:1877760428563072:0@lo:104: 00010000:00010000:2.0:1790772243.076694:0:14780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772243.076702:0:14780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772243.076709:0:14780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772243.076715:0:14780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df240030e00/0xdf68d9a7d6a90f7d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772243.748058:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790772244.134057:0:14344:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772244.134067:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df27f91f800 from 10 10000000:01000000:0.0:1790772244.134074:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772244.134134:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772244.134147:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772244.134160:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772244.134191:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428563328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772244.134301:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772244.134362:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df250bb00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772244.134427:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428563328 00000100:00100000:3.0:1790772244.134437:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428563328 00000100:00100000:3.0:1790772244.134500:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790772244.134521:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+11:14344:x1877760428563328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772244.134537:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772244.134595:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241327200/0xdf68d9a7d6a90f8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90f84 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772244.134633:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241327200/0xdf68d9a7d6a90f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f84 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772244.134644:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241327200/0xdf68d9a7d6a90f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f84 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772244.134654:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241327200, rc 0) 00000100:00100000:3.0:1790772244.134696:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14344:x1877760428563328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772244.134704:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790772244.135174:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428563328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772244.135192:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772244.135215:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772244.135294:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428563456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772244.135327:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772244.135367:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df250bb00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772244.135465:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428563456 00000100:00100000:3.0:1790772244.135472:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428563456 00000100:00100000:3.0:1790772244.135518:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772244.135527:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14344:x1877760428563456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772244.135875:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14344:x1877760428563456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772244.136166:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790772244.136456:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428563456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772244.136501:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428563584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772244.136602:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772244.136643:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df250bb00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772244.138828:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428563584 00000100:00100000:3.0:1790772244.138847:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428563584 00000100:00100000:3.0:1790772244.138924:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790772244.138935:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14344:x1877760428563584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772244.139476:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+12:14344:x1877760428563584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 541us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772244.139485:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790772244.139606:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428563584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790772244.146357:0:14806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790772244.147503:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790772244.147534:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790772244.147575:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772244.147591:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790772244.448820:0:2348:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772244.448830:0:2348:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790772244.448832:0:2348:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772244.448835:0:2348:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790772244.448901:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772244.448919:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428563712:0@lo:400:kworker.0 00000100:00100000:0.0:1790772244.448982:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772244.449049:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428563712 00000100:00100000:0.0:1790772244.449056:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428563712 00000100:00100000:0.0:1790772244.449094:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772244.449103:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428563712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772244.449166:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428563712:12345-0@lo:400:kworker.0 Request processed in 63us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772244.449174:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790772244.449219:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df27ae0ed80 x1877760428563712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772244.449232:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428563712:0@lo:400:kworker.0 00000100:00100000:0.0:1790772244.449982:0:3292:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772234/real 1790772234] req@ffff8df26f3e9880 x1877760428560256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772244.450001:0:3292:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df26f3e9880 x1877760428560256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772244.450044:0:3292:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772234/real 1790772234] req@ffff8df26f3e8000 x1877760428560128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772244.450058:0:3292:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df26f3e8000 x1877760428560128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790772244.450070:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df245b7f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772244.450084:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790772244.450087:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428560256:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790772244.450092:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df26fb2a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772244.450097:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790772244.450100:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428560128:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790772244.450121:0:2348:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772244.450125:0:2348:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790772244.450127:0:2348:0:(import.c:65:import_set_state_nolock()) ffff8df26fb2a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772244.450131:0:2348:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:0.0:1790772244.450135:0:2348:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790772244.450153:0:2348:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df26fb2a800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1790772244.450176:0:2348:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27ae0ed80 x1877760428563840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772244.450191:0:2348:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790772244.450194:0:2348:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790772244.450196:0:2348:0:(import.c:65:import_set_state_nolock()) ffff8df245b7f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790772244.450208:0:2348:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:0.0:1790772244.450216:0:2348:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790772244.450222:0:2348:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df245b7f000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1790772244.450235:0:2348:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27ae0ca80 x1877760428563968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790772244.450255:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428563840:0@lo:8:kworker.0 00000400:00000100:0.0:1790772244.450282:0:3292:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760428563840 offset 0 length 520: 4 00000100:00100000:0.0:1790772244.450307:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428563968:0@lo:8:kworker.0 00000400:00000100:0.0:1790772244.450319:0:3292:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877760428563968 offset 0 length 520: 4 00010000:00010000:0.0:1790772244.768957:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772245.797809:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772246.496339:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790772246.816168:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772247.842699:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790772248.762758:0:15028:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790772248.762762:0:15028:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1790772248.762870:0:15028:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df259054800 00000020:01000004:1.0:1790772248.762885:0:15028:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1790772248.762897:0:15028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790772248.762909:0:15028:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8df259073380) 00000020:00000080:1.0:1790772248.762935:0:15028:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790772248.789430:0:15028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790772248.789675:0:15028:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1790772248.791160:0:15028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790772248.791513:0:15028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1790772248.791747:0:15028:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1790772248.796509:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1790772248.796739:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1790772248.796888:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1790772248.798738:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 362: rc = 0 00100000:10000000:1.0:1790772248.803613:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 362: rc = 0 00100000:10000000:1.0:1790772248.803885:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 362: rc = 0 00100000:10000000:1.0:1790772248.805331:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 362: rc = 0 00100000:10000000:1.0:1790772248.805689:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 362: rc = 0 00100000:10000000:1.0:1790772248.806246:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 362: rc = 0 00000020:00000080:1.0:1790772248.807242:0:15028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790772248.807252:0:15028:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790772248.807262:0:15028:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdf68d9a7d6a90f99 00000020:01000004:1.0:1790772248.807269:0:15028:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1790772248.807287:0:15028:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.127@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790772248.807290:0:15028:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790772248.807296:0:15028:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790772248.807300:0:15028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790772248.807310:0:15028:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8df259074d40) 00000020:00000080:1.0:1790772248.807319:0:15028:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1790772248.809674:0:15028:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772248.809986:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790772248.809993:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790772248.819505:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790772248.820381:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790772248.820820:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790772248.820827:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790772248.825662:0:15028:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772248.825843:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790772248.825849:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790772248.832250:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790772248.832268:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1790772248.863778:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772248.896496:0:15028:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772248.896752:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790772248.896758:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790772248.898493:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790772248.898503:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790772248.900259:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790772248.900272:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790772248.904357:0:15028:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772248.905160:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790772248.905167:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790772248.905885:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790772248.905892:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790772248.986827:0:15028:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772248.992882:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790772248.992892:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790772248.994028:0:15028:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790772248.994038:0:15028:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790772248.994927:0:15028:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790772248.994952:0:15028:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1790772248.994958:0:15028:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790772249.021700:0:15028:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790772249.022026:0:15028:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.127@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790772249.022031:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790772249.022033:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790772249.022034:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772249.022035:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772249.022036:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772249.022038:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772249.022039:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772249.022041:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772249.022042:0:15028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790772249.022046:0:15028:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790772249.022048:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790772249.022049:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790772249.022051:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772249.022052:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772249.022053:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772249.022054:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772249.022055:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772249.022056:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772249.022057:0:15028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790772249.022084:0:15028:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790772249.022105:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790772249.022186:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772249.022350:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1790772249.023987:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428564096 00000100:00100000:0.0:1790772249.023998:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428564096 00000100:00100000:0.0:1790772249.024055:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790772249.024065:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:15028:x1877760428564096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790772249.024097:0:14340:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790772249.024101:0:14340:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790772249.024104:0:14340:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790772249.053479:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:15028:x1877760428564096:12345-0@lo:253:mount.lustre.0 Request processed in 29407us (31296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772249.053492:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790772249.053801:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790772249.053816:0:15028:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790772249.053819:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772249.053821:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790772249.053822:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772249.053823:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772249.053825:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772249.053826:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772249.053827:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772249.053829:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772249.053831:0:15028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790772249.053923:0:15028:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df259054800 from lustre-OST0000 10000000:01000000:0.0:1790772249.053945:0:15028:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790772249.053948:0:15028:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790772249.053954:0:15028:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df2581c99c0 local copy 00010000:00010000:0.0:1790772249.053964:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90e96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772249.054167:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772249.054223:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772249.054296:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df245aad240 going to sleep for 11 seconds 00000100:00100000:3.0:1790772249.054417:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428564224 00000100:00100000:3.0:1790772249.054423:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428564224 00000100:00100000:3.0:1790772249.054577:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772249.054587:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+12:15028:x1877760428564224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772249.054797:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+12:15028:x1877760428564224:12345-0@lo:501:mount.lustre.0 Request processed in 212us (573us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790772249.054805:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790772249.054976:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564224:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790772249.054992:0:15028:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790772249.055138:0:15028:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790772249.055145:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90e96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.055155:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90e96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772249.055183:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df259054800 10000000:01000000:0.0:1790772249.055189:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790772249.055193:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8df2581c99c0 10000000:01000000:0.0:1790772249.055195:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790772249.055199:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8df2581c99c0 from 1 10000000:01000000:0.0:1790772249.055201:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790772249.055224:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031000/0xdf68d9a7d6a90fa7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.055232:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df240031000/0xdf68d9a7d6a90fa7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.055240:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df240031000/0xdf68d9a7d6a90fa7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772249.055255:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790772249.055285:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772249.055416:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df245aad240 going to sleep for 11 seconds 00000100:00100000:1.0:1790772249.058520:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428564352 00000100:00100000:1.0:1790772249.058659:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428564352 00000100:00100000:1.0:1790772249.058822:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790772249.058833:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+12:15028:x1877760428564352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772249.058849:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772249.058942:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b9000/0xdf68d9a7d6a90fae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90fa7 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.058988:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b9000/0xdf68d9a7d6a90fae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90fa7 expref: 13 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.058998:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b9000/0xdf68d9a7d6a90fae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90fa7 expref: 13 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.059006:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9000, rc 0) 00000100:00100000:1.0:1790772249.059088:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+13:15028:x1877760428564352:12345-0@lo:101:mount.lustre.0 Request processed in 257us (3801us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772249.059095:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790772249.059848:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772249.059869:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df240031000/0xdf68d9a7d6a90fa7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fae expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.059880:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df240031000/0xdf68d9a7d6a90fa7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90fae expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772249.059904:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790772249.059928:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031000/0xdf68d9a7d6a90fa7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fae expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.059936:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df240031000/0xdf68d9a7d6a90fa7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fae expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772249.059944:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790772249.059950:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790772249.059956:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790772249.059959:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790772249.059992:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aae00/0xdf68d9a7d6a90fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.060000:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9aae00/0xdf68d9a7d6a90fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.060009:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9aae00/0xdf68d9a7d6a90fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772249.060028:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790772249.060067:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772249.060097:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a7000 going to sleep for 11 seconds 00000100:00100000:1.0:1790772249.060581:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428564480 00000100:00100000:1.0:1790772249.060695:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428564480 00000100:00100000:2.0:1790772249.060852:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790772249.060860:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+13:15028:x1877760428564480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772249.060871:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772249.060883:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9ab600/0xdf68d9a7d6a90fbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90fb5 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.060903:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9ab600/0xdf68d9a7d6a90fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90fb5 expref: 14 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.060913:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9ab600/0xdf68d9a7d6a90fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90fb5 expref: 14 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.060921:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab600, rc 0) 00000100:00100000:2.0:1790772249.060964:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+14:15028:x1877760428564480:12345-0@lo:101:mount.lustre.0 Request processed in 104us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772249.060970:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790772249.061005:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772249.061025:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9aae00/0xdf68d9a7d6a90fb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fbc expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.061033:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9aae00/0xdf68d9a7d6a90fb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90fbc expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772249.064802:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1790772249.065737:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772249.065958:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1790772249.066000:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1790772249.066031:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1790772249.066075:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1790772249.066108:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1790772249.066137:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1790772249.066205:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1790772249.066213:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1790772249.066279:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772249.066334:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772249.066377:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a7180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772249.067011:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428564608 00000100:00100000:3.0:1790772249.067019:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428564608 00000100:00100000:3.0:1790772249.067078:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790772249.067087:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+14:15028:x1877760428564608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772249.067459:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+14:15028:x1877760428564608:12345-0@lo:501:mount.lustre.0 Request processed in 372us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772249.067467:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790772249.067923:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772249.067963:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772249.068004:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772249.068071:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a7180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772249.072169:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428564736 00000100:00100000:3.0:1790772249.072194:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428564736 00000100:00100000:3.0:1790772249.072263:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790772249.072274:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+14:15028:x1877760428564736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772249.073163:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+14:15028:x1877760428564736:12345-0@lo:503:mount.lustre.0 Request processed in 889us (5155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772249.073172:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790772249.073278:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790772249.074071:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772249.074143:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772249.074199:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772249.074238:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a7180 going to sleep for 11 seconds 00000100:00100000:0.0:1790772249.074304:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428564864 00000100:00100000:0.0:1790772249.074310:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428564864 00000100:00100000:0.0:1790772249.074358:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790772249.074367:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+14:15028:x1877760428564864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772249.074580:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+14:15028:x1877760428564864:12345-0@lo:502:mount.lustre.0 Request processed in 213us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772249.074859:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772249.075082:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790772249.075131:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790772249.075194:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790772249.075245:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790772249.075283:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790772249.075315:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790772249.075370:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790772249.075402:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790772249.075430:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1790772249.075477:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1790772249.075509:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1790772249.075575:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1790772249.076050:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790772249.076216:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772249.076269:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772249.076365:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a7180 going to sleep for 11 seconds 00000100:00100000:1.0:1790772249.077588:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428564992 00000100:00100000:1.0:1790772249.077598:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428564992 00000100:00100000:1.0:1790772249.077647:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790772249.077655:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+14:15028:x1877760428564992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772249.077877:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+14:15028:x1877760428564992:12345-0@lo:502:mount.lustre.0 Request processed in 222us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772249.077884:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790772249.078833:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428564992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772249.078963:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1790772249.078977:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1790772249.081031:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790772249.081040:0:15043:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1790772249.081049:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772249.081052:0:15043:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790772249.081058:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790772249.081073:0:15043:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8df27fad0000) 00000020:00000080:2.0:1790772249.081093:0:15043:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790772249.081098:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790772249.081170:0:15043:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df259054800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790772249.081189:0:15043:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790772249.081201:0:15043:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdf68d9a7d6a90fca 00010000:00010000:0.0:1790772249.099649:0:15043:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1790772249.100035:0:15043:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1790772249.101667:0:15043:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790772249.106154:0:15043:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790772249.106165:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772249.106172:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772249.106186:0:15043:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790772249.106191:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790772249.106193:0:15043:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1790772249.106195:0:15043:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790772249.106197:0:15043:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790772249.106198:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790772249.106201:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772249.106202:0:15043:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790772249.106205:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772249.106208:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772249.106209:0:15043:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790772249.106213:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790772249.106215:0:15043:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790772249.106217:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772249.106219:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772249.106220:0:15043:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790772249.106223:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790772249.106225:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772249.106226:0:15043:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790772249.106230:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790772249.106289:0:15043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790772249.106292:0:15043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772249.106294:0:15043:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790772249.106296:0:15043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1790772249.108040:0:15028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1790772249.108080:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790772249.108108:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aae00/0xdf68d9a7d6a90fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fbc expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.108120:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9aae00/0xdf68d9a7d6a90fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fbc expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772249.108140:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df259054800 from 1 10000000:01000000:1.0:1790772249.108142:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772249.108186:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.108195:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.108205:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772249.108228:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790772249.108288:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772249.108320:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2492259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772249.110473:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428565120 00000100:00100000:3.0:1790772249.110484:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428565120 00000100:00100000:3.0:1790772249.110534:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790772249.110544:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+14:15028:x1877760428565120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772249.110583:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772249.110599:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241326e00/0xdf68d9a7d6a90fd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90fd1 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772249.110635:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241326e00/0xdf68d9a7d6a90fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90fd1 expref: 15 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772249.110646:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241326e00/0xdf68d9a7d6a90fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90fd1 expref: 15 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772249.110655:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241326e00, rc 0) 00000100:00100000:3.0:1790772249.110719:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428565120:12345-0@lo:101:mount.lustre.0 Request processed in 176us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772249.110726:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790772249.111047:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772249.111067:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.111075:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772249.111609:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790772249.112088:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772249.112348:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790772249.112388:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790772249.112448:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790772249.112457:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790772249.112526:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772249.112610:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772249.112648:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2492259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772249.112675:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428565248 00000100:00100000:1.0:1790772249.112682:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428565248 00000100:00100000:1.0:1790772249.112715:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790772249.112723:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428565248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772249.112901:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428565248:12345-0@lo:501:mount.lustre.0 Request processed in 177us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772249.112908:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790772249.112947:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772249.112974:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772249.113012:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772249.113027:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2492259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772249.113039:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428565376 00000100:00100000:1.0:1790772249.113043:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428565376 00000100:00100000:1.0:1790772249.113059:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790772249.113065:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428565376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772249.113198:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428565376:12345-0@lo:503:mount.lustre.0 Request processed in 132us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772249.113204:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790772249.113243:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565376:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790772249.118193:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790772249.118293:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772249.118468:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772249.118513:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25913ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772249.118739:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428565504 00000100:00100000:1.0:1790772249.118746:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428565504 00000100:00100000:1.0:1790772249.118795:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790772249.118804:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428565504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772249.119056:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428565504:12345-0@lo:502:mount.lustre.0 Request processed in 253us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772249.119064:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790772249.120153:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772249.120778:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790772249.120844:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790772249.120900:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790772249.120939:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790772249.120975:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790772249.121038:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790772249.121073:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790772249.121104:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1790772249.121146:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772249.121223:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772249.121308:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772249.123282:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428565632 00000100:00100000:0.0:1790772249.123295:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428565632 00000100:00100000:0.0:1790772249.125935:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790772249.125959:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428565632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772249.126255:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428565632:12345-0@lo:502:mount.lustre.0 Request processed in 307us (5031us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772249.126263:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790772249.126403:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772249.126609:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790772249.126626:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1790772249.136082:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772249.136098:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772249.136101:0:15047:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790772249.136110:0:15047:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df259054800 00000020:00000080:3.0:1790772249.136112:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790772249.136120:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772249.136122:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772249.136123:0:15047:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790772249.136126:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772249.136128:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772249.136129:0:15047:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790772249.136132:0:15047:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df259054800 00000020:00000080:3.0:1790772249.136134:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790772249.136301:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772249.136306:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772249.136307:0:15047:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790772249.136310:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790772249.136313:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772249.136314:0:15047:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790772249.136317:0:15047:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df259054800 00000020:00000080:3.0:1790772249.140804:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790772249.140916:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790772249.140922:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790772249.140923:0:15047:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790772249.140927:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790772249.141075:0:15028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790772249.141102:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790772249.141125:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.141136:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772249.141186:0:15028:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790772249.141189:0:15028:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df259054800 10000000:01000000:2.0:1790772249.141192:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df259054800 10000000:01000000:2.0:1790772249.141196:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790772249.141201:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df259054800 from 1 10000000:01000000:2.0:1790772249.141204:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790772249.141239:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aba00/0xdf68d9a7d6a90fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.141247:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9aba00/0xdf68d9a7d6a90fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.141258:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9aba00/0xdf68d9a7d6a90fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772249.141290:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790772249.141375:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772249.141407:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790772249.142578:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428565760 00000100:00100000:3.0:1790772249.142589:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428565760 00000100:00100000:3.0:1790772249.142637:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790772249.142646:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428565760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772249.142660:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772249.142673:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241326000/0xdf68d9a7d6a90fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a90fdf expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772249.142695:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241326000/0xdf68d9a7d6a90fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90fdf expref: 16 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772249.142705:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241326000/0xdf68d9a7d6a90fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90fdf expref: 16 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772249.142713:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241326000, rc 0) 00000100:00100000:3.0:1790772249.142764:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15028:x1877760428565760:12345-0@lo:101:mount.lustre.0 Request processed in 119us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772249.142771:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790772249.143129:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772249.143148:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9aba00/0xdf68d9a7d6a90fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fe6 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.143157:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9aba00/0xdf68d9a7d6a90fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a90fe6 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772249.143777:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790772249.144225:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772249.144471:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790772249.144521:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790772249.144586:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790772249.144637:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790772249.144676:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790772249.144726:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790772249.144765:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790772249.144797:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790772249.144847:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790772249.144885:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790772249.144917:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790772249.144977:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790772249.145020:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790772249.145074:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790772249.145143:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790772249.145197:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790772249.145231:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790772249.145296:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790772249.145333:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790772249.145365:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790772249.145426:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790772249.145466:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790772249.145502:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790772249.145580:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790772249.145617:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790772249.145651:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790772249.145697:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790772249.145733:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790772249.145802:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790772249.145809:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790772249.145895:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772249.154282:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772249.154353:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772249.158865:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428565888 00000100:00100000:0.0:1790772249.158879:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428565888 00000100:00100000:0.0:1790772249.158931:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790772249.158940:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15028:x1877760428565888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772249.159237:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15028:x1877760428565888:12345-0@lo:501:mount.lustre.0 Request processed in 297us (4961us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772249.159252:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790772249.159282:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428565888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772249.159340:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428566016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772249.159384:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772249.159411:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428566016 00000100:00100000:3.0:1790772249.159415:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428566016 00000100:00100000:3.0:1790772249.159460:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790772249.159474:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15028:x1877760428566016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772249.159833:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15028:x1877760428566016:12345-0@lo:503:mount.lustre.0 Request processed in 360us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772249.159841:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790772249.159882:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df241377780 going to sleep for 11 seconds 00000100:00100000:3.0:1790772249.159895:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428566016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790772249.160848:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790772249.160927:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428566144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772249.160970:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772249.161002:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428566144 00000100:00100000:3.0:1790772249.161004:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27af24900 going to sleep for 11 seconds 00000100:00100000:0.0:1790772249.161008:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428566144 00000100:00100000:0.0:1790772249.161039:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790772249.161047:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15028:x1877760428566144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772249.161238:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15028:x1877760428566144:12345-0@lo:502:mount.lustre.0 Request processed in 191us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772249.161245:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790772249.161297:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428566144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790772249.162124:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790772249.162193:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790772249.162226:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790772249.162269:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790772249.162303:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790772249.162368:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790772249.162411:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790772249.162474:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790772249.162524:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790772249.162611:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790772249.162651:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790772249.162703:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790772249.162992:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790772249.163027:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790772249.163093:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790772249.163131:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790772249.163164:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790772249.163230:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790772249.163267:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790772249.163303:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790772249.163349:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790772249.163386:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790772249.163413:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790772249.163916:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790772249.163966:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1790772249.164022:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1790772249.164223:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1790772249.164264:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1790772249.164312:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1790772249.164362:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1790772249.164403:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1790772249.164831:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1790772249.164879:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1790772249.164934:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1790772249.164975:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1790772249.165027:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1790772249.165223:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1790772249.165265:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1790772249.165322:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1790772249.165362:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1790772249.165411:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428566272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772249.166192:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772249.166243:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428566272 00000100:00100000:3.0:1790772249.166250:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428566272 00000100:00100000:3.0:1790772249.166294:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790772249.166301:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15028:x1877760428566272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772249.166534:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15028:x1877760428566272:12345-0@lo:502:mount.lustre.0 Request processed in 233us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772249.166567:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790772249.166631:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27af24900 going to sleep for 11 seconds 00000100:00100000:3.0:1790772249.166651:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428566272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790772249.166857:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790772249.166869:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1790772249.177854:0:15052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790772249.177877:0:15052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8df143a54d40) 00000020:00000080:2.0:1790772249.177897:0:15052:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1790772249.177964:0:15052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df259054800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790772249.177968:0:15052:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df259054800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790772249.177970:0:15052:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df259054800 3 00010000:00080000:2.0:1790772249.177999:0:15052:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df27abbf800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.127@tcp at head 00010000:00010000:2.0:1790772249.179679:0:15052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1790772249.179879:0:15052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790772249.179913:0:15052:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790772249.179924:0:15052:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdf68d9a7d6a90ff4 00000100:00080000:2.0:1790772249.179934:0:15052:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790772249.179944:0:15052:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df27abbf800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:2.0:1790772249.179978:0:15052:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27401c380 x1877760428566400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772249.180015:0:15052:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790772249.180044:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1877760428566400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790772249.180578:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790772249.183853:0:2348:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772249.183862:0:2348:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790772249.183864:0:2348:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772249.183868:0:2348:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790772249.183946:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772249.183962:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428566528:0@lo:400:kworker.0 00000100:00100000:3.0:1790772249.184017:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772249.184399:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428566400 00000100:00100000:0.0:1790772249.184406:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428566400 00000100:00100000:0.0:1790772249.184433:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428566528 00000100:00100000:0.0:1790772249.184436:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428566528 00000100:00100000:0.0:1790772249.184459:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772249.184467:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428566528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772249.184530:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428566528:12345-0@lo:400:kworker.0 Request processed in 63us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772249.184537:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772249.184576:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772249.184581:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3292:x1877760428566400:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790772249.184600:0:14347:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:0.0:1790772249.184635:0:14347:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdf68d9a7d6a90ffb 00000004:00100000:0.0:1790772249.184648:0:14347:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790772249.184683:0:14347:0:(import.c:65:import_set_state_nolock()) ffff8df245333800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772249.184731:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877760428566400:12345-0@lo:38:llog_process_th.0 Request processed in 149us (4155us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772249.184873:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790772249.184915:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df27401c380 x1877760428566400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772249.184924:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790772249.184932:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1790772249.184939:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790772249.184943:0:3292:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790772249.184946:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df27abbf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790772249.184952:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1877760428566400:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790772249.187272:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df27f9c4700 x1877760428566528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772249.187287:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428566528:0@lo:400:kworker.0 00000040:00080000:3.0:1790772249.187996:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1790772249.188045:0:15028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790772249.188068:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790772249.188083:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aba00/0xdf68d9a7d6a90fdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fe6 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772249.188094:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9aba00/0xdf68d9a7d6a90fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90fe6 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790772249.188134:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790772249.188139:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790772249.188141:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772249.188142:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772249.188144:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772249.188145:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772249.188147:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772249.188149:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772249.188150:0:15028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790772249.188154:0:15028:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1790772249.188156:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790772249.188157:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790772249.188157:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772249.188158:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772249.188159:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772249.188160:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772249.188161:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772249.188162:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772249.188162:0:15028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790772249.188195:0:15028:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790772249.188215:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428566656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790772249.188273:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772249.188304:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27af24a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772249.188327:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428566656 00000100:00100000:3.0:1790772249.190416:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428566656 00000100:00100000:3.0:1790772249.190476:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790772249.190485:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15028:x1877760428566656:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790772249.190514:0:14341:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790772249.190526:0:14341:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790772249.225268:0:14341:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790772249.225289:0:14341:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790772249.227694:0:14362:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790772249.227705:0:14362:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790772249.228236:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.228254:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241326a00/0xdf68d9a7d6a90f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f68 expref: 16 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.228262:0:14362:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.228302:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241326a00/0xdf68d9a7d6a90f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a90f68 expref: 16 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.228316:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df241326a00/0xdf68d9a7d6a90f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f68 expref: 16 pid: 14340 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772249.228329:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14362:1877760428566784:0@lo:104: 00000100:00100000:2.0:1790772249.228391:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772249.228836:0:14331:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428566784 00000100:00100000:1.0:1790772249.228844:0:14331:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428566784 00000100:00100000:1.0:1790772249.228892:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772249.228900:0:14331:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+3:14362:x1877760428566784:12345-0@lo:104: 00010000:00010000:1.0:1790772249.228911:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.228962:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790772249.228968:0:14331:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+3:14362:x1877760428566784:12345-0@lo:104: Request processed in 70us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772249.228975:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772249.229252:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772249.229274:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14362:1877760428566784:0@lo:104: 00010000:00010000:2.0:1790772249.229295:0:14362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.229371:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772249.229378:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.229386:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa800 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772249.229390:0:14335:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.229398:0:14335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772249.229405:0:14335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772249.229873:0:14335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790772249.229914:0:14335:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.229921:0:14335:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772249.229952:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.229960:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa800/0xdf68d9a7d6a90f68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f6f expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772249.229976:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772249.229977:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772249.229979:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772249.229992:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772249.230002:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f131dbd3-adf7-4830-81da-ffe0e188139b:3294:1877760428566912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772249.230043:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772249.230099:0:14334:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428566912 00000100:00100000:0.0:1790772249.230105:0:14334:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428566912 00010000:00010000:0.0:1790772249.230128:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241326a00/0xdf68d9a7d6a90f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f68 expref: 17 pid: 14340 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772249.230150:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772249.230157:0:14334:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f131dbd3-adf7-4830-81da-ffe0e188139b+17:3294:x1877760428566912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790772249.230168:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772249.230182:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241326a00/0xdf68d9a7d6a90f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f68 expref: 17 pid: 14340 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230193:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241326a00/0xdf68d9a7d6a90f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f68 expref: 17 pid: 14340 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230210:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241326a00/0xdf68d9a7d6a90f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f68 expref: 17 pid: 14340 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230236:0:14334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230244:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790772249.230257:0:14334:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002553232s 00010000:00010000:0.0:1790772249.230262:0:14334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230268:0:14334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230274:0:14334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230280:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230285:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9abc00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772249.230288:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230295:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230307:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772249.230316:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772249.230715:0:14362:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.230724:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772249.230736:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a91002 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772249.230998:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f131dbd3-adf7-4830-81da-ffe0e188139b:3294:1877760428566912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790772249.231003:0:14334:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f131dbd3-adf7-4830-81da-ffe0e188139b+16:3294:x1877760428566912:12345-0@lo:103:ldlm_bl.0 Request processed in 847us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772249.231010:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772249.234580:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+15:15028:x1877760428566656:12345-0@lo:253:mount.lustre.0 Request processed in 44087us (46298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772249.234594:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790772249.234691:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15028:1877760428566656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790772249.234706:0:15028:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790772249.234709:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790772249.234710:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790772249.234712:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772249.234713:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772249.234714:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772249.234730:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772249.234731:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790772249.234733:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772249.234734:0:15028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790772249.234749:0:15028:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790772249.239256:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772249.239422:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790772249.239817:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772249.239978:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790772249.240213:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772249.240410:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790772249.241227:0:15028:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790772249.290386:0:15028:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790772249.290395:0:15028:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790772249.290427:0:15028:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790772249.290614:0:15028:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790772249.290628:0:15028:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790772249.290655:0:15028:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1790772249.888327:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790772250.591734:0:14344:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790772250.591741:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df27f91f800 from 7 10000000:01000000:2.0:1790772250.591745:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790772250.591786:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772250.591798:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772250.591809:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772250.591831:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428567040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790772250.591894:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772250.591936:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772250.592099:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428567040 00000100:00100000:3.0:1790772250.592107:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428567040 00000100:00100000:3.0:1790772250.592179:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790772250.592188:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+15:14344:x1877760428567040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772250.592202:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772250.592215:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241326400/0xdf68d9a7d6a91010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a91009 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772250.592426:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241326400/0xdf68d9a7d6a91010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a91009 expref: 16 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772250.592437:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241326400/0xdf68d9a7d6a91010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a91009 expref: 16 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772250.592455:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241326400, rc 0) 00000100:00100000:3.0:1790772250.592501:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+16:14344:x1877760428567040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 314us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772250.592507:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790772250.592601:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428567040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772250.592616:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772250.592625:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772250.592673:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428567168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790772250.592704:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772250.592976:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df247d6bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790772250.596268:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428567168 00000100:00100000:2.0:1790772250.596281:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428567168 00000100:00100000:2.0:1790772250.596340:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790772250.596350:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+16:14344:x1877760428567168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790772250.596375:0:14340:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790772250.596391:0:14340:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790772250.596394:0:14340:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1790772250.598106:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+16:14344:x1877760428567168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1751us (5395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772250.598130:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790772250.598494:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428567168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790772250.598581:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790772250.598591:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772250.598601:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772250.914927:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772251.942831:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772252.964984:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772253.984178:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790772254.689288:0:12647:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772254.689294:0:12647:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790772254.689297:0:12647:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772254.689299:0:12647:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790772254.689417:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f131dbd3-adf7-4830-81da-ffe0e188139b:3294:1877760428567296:0@lo:400:kworker.0 00000100:00100000:0.0:1790772254.689530:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772254.689609:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428567552:0@lo:400:kworker.0 00000100:00100000:0.0:1790772254.689635:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772254.689653:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772254.689659:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428567424:0@lo:400:kworker.0 00000100:00100000:0.0:1790772254.689678:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772254.689702:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428567296 00000100:00100000:0.0:1790772254.689709:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428567296 00000100:00100000:0.0:1790772254.689745:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790772254.689753:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+16:3294:x1877760428567296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772254.689798:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+16:3294:x1877760428567296:12345-0@lo:400:kworker.0 Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772254.689806:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790772254.689834:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428567552 00000100:00100000:0.0:1790772254.689844:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428567552 00000100:00100000:0.0:1790772254.689877:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428567424 00000100:00100000:0.0:1790772254.689879:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428567424 00000100:00100000:0.0:1790772254.689892:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772254.689897:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428567552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772254.689931:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428567552:12345-0@lo:400:kworker.0 Request processed in 34us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772254.689938:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772254.689950:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790772254.689956:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428567424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772254.689982:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428567424:12345-0@lo:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772254.689988:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790772254.690028:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df26f3ead80 x1877760428567424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772254.690039:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428567424:0@lo:400:kworker.0 00010000:00080000:0.0:1790772254.690049:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df26f3ebb80 x1877760428567552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772254.690058:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428567552:0@lo:400:kworker.0 00000100:00100000:0.0:1790772254.690082:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f131dbd3-adf7-4830-81da-ffe0e188139b:3294:1877760428567296:0@lo:400:kworker.0 00000100:00080000:3.0:1790772254.690712:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790772255.008276:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790772255.549288:0:15398:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790772256.031836:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790772256.737095:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790772257.055842:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772258.085085:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772259.106905:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772259.423905:0:3292:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772244/real 1790772244] req@ffff8df27ae0ed80 x1877760428563840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772259 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772259.423945:0:3292:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df27ae0ed80 x1877760428563840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772259 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772259.423957:0:3292:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790772244/real 1790772244] req@ffff8df27ae0ca80 x1877760428563968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772259 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772259.423969:0:3292:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df27ae0ca80 x1877760428563968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790772259 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790772259.423986:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df26fb2a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772259.424009:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790772259.424013:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428563840:0@lo:8:kworker.0 00000100:00080000:1.0:1790772259.424019:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df245b7f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772259.424043:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790772259.424046:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428563968:0@lo:8:kworker.0 00000100:00080000:3.0:1790772259.424193:0:12647:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772259.424198:0:12647:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790772259.424200:0:12647:0:(import.c:65:import_set_state_nolock()) ffff8df26fb2a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790772259.424205:0:12647:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:3.0:1790772259.424210:0:12647:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790772259.424219:0:12647:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df26fb2a800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1790772259.424238:0:12647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27f9c7480 x1877760428567808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790772259.424260:0:12647:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790772259.424263:0:12647:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790772259.424264:0:12647:0:(import.c:65:import_set_state_nolock()) ffff8df245b7f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790772259.424267:0:12647:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:3.0:1790772259.424269:0:12647:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790772259.424273:0:12647:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df245b7f000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1790772259.424290:0:12647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27f9c4000 x1877760428567936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790772259.424348:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428568192:0@lo:400:kworker.0 00000100:00100000:3.0:1790772259.424417:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772259.424488:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428568192 00000100:00100000:3.0:1790772259.424496:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428568192 00000100:00100000:3.0:1790772259.424546:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790772259.424575:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428568192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772259.424623:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428568192:12345-0@lo:400:kworker.0 Request processed in 49us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772259.424630:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790772259.424649:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790772259.424672:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27f9c4380 x1877760428568192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790772259.424683:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428568192:0@lo:400:kworker.0 00000100:00100000:2.0:1790772259.424812:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428567808:0@lo:8:kworker.0 00000100:00100000:2.0:1790772259.424846:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772259.424881:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428567936:0@lo:8:kworker.0 00000100:00100000:2.0:1790772259.424905:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772259.424952:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428567808 00000100:00100000:2.0:1790772259.424956:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428567808 00000100:00100000:2.0:1790772259.424972:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428567936 00000100:00100000:2.0:1790772259.424974:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428567936 00000100:00100000:2.0:1790772259.424984:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772259.424989:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1877760428567808:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790772259.425010:0:15031:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:2.0:1790772259.425034:0:15031:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf68d9a7d6a91017 00002000:00100000:2.0:1790772259.425047:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8df27ab8c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790772259.425051:0:15031:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790772259.425054:0:15031:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790772259.425391:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790772259.425412:0:15031:0:(import.c:65:import_set_state_nolock()) ffff8df27ab89000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772259.425459:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1877760428567808:12345-0@lo:8:kworker.0 Request processed in 468us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772259.425466:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772259.425483:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772259.425488:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1877760428567936:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790772259.425498:0:15031:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790772259.425524:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1877760428567936:12345-0@lo:8:kworker.0 Request processed in 35us (617us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790772259.425530:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790772259.425593:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27f9c7480 x1877760428567808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772259.425602:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790772259.425609:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790772259.425615:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790772259.425620:0:3292:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790772259.425622:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df26fb2a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790772259.425633:0:3292:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790772259.425637:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428567808:0@lo:8:kworker.0 00000100:00080000:2.0:1790772259.425648:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df245b7f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790772259.425652:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790772259.425655:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428567936:0@lo:8:kworker.0 00000100:00100000:0.0:1790772259.425923:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428567680:0@lo:400:kworker.0 00000100:00100000:0.0:1790772259.425960:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772259.425999:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772259.426005:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428568064:0@lo:400:kworker.0 00000100:00100000:0.0:1790772259.426039:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772259.426071:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428568064 00000100:00100000:0.0:1790772259.426076:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428568064 00000100:00100000:0.0:1790772259.426101:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772259.426107:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428568064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772259.426169:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428568064:12345-0@lo:400:kworker.0 Request processed in 61us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772259.426175:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790772259.426205:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27f9c5f80 x1877760428568064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772259.426214:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428568064:0@lo:400:kworker.0 00000100:00100000:2.0:1790772259.426450:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428567680 00000100:00100000:2.0:1790772259.426455:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428567680 00000100:00100000:2.0:1790772259.426490:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790772259.426497:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+16:3293:x1877760428567680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772259.426537:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+16:3293:x1877760428567680:12345-0@lo:400:kworker.0 Request processed in 41us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772259.426544:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790772259.426599:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428567680:0@lo:400:kworker.0 00000004:00080000:3.0:1790772259.426788:0:14369:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1790772259.426808:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14369:1877760428568448:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790772259.426840:0:14369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772259.426871:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2745d4840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772259.426886:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790772259.426894:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428568320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790772259.426918:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772259.426957:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428568448 00000100:00100000:3.0:1790772259.426961:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428568448 00000100:00100000:3.0:1790772259.426994:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790772259.427002:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14369:x1877760428568448:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790772259.428271:0:14368:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790772259.428671:0:14368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425573120803ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790772259.429181:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428568320 00000100:00100000:0.0:1790772259.429191:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428568320 00000100:00100000:0.0:1790772259.429240:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772259.429250:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428568320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772259.429279:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772259.429367:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428568320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (2448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772259.429384:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790772259.436621:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27f9c4380 x1877760428568320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772259.436651:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428568320:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790772259.441921:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1790772259.447531:0:15031:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790772259.447541:0:15031:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1790772259.447546:0:15031:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1790772259.476830:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.476843:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9101e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.478994:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.479000:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.479008:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9101e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.479037:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9101e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.479048:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9101e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.479057:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9101e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.479308:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772259.479486:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.479494:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9101e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.479502:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326a00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.479507:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9101e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.479516:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9101e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.479534:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9101e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.479541:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9101e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.479580:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.479582:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.479584:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.481539:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.481575:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a91025 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.481591:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.481603:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.481609:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a91025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.481621:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a91025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.481630:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a91025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.481638:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a91025 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.481654:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772259.482887:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.482897:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a9102c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.482911:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.482916:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.482921:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a9102c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.482932:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a9102c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.482942:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a9102c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.482956:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a9102c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.482965:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772259.482980:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772259.483781:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.483790:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed61765c/0xdf68d9a7d6a91033 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.483802:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.483805:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.483809:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed61765c/0xdf68d9a7d6a91033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.483820:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed61765c/0xdf68d9a7d6a91033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.483829:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed61765c/0xdf68d9a7d6a91033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.483837:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed61765c/0xdf68d9a7d6a91033 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492489:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a91025 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492509:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772259.492514:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a91025 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492546:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a91025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492586:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a91025 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492594:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a91025 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492620:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790772259.492625:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a9102c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492630:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772259.492634:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a9102c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492641:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a9102c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492651:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a9102c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492659:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a9102c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492683:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772259.492688:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed61765c/0xdf68d9a7d6a91033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492694:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327600 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772259.492697:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed61765c/0xdf68d9a7d6a91033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492704:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed61765c/0xdf68d9a7d6a91033 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492715:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed61765c/0xdf68d9a7d6a91033 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772259.492722:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772259.492723:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772259.492726:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.493716:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.495888:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790772259.495903:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed61765c/0xdf68d9a7d6a91033 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772259.497676:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.497687:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bce7b14/0xdf68d9a7d6a9103a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.497702:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.497707:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.497713:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bce7b14/0xdf68d9a7d6a9103a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.497725:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bce7b14/0xdf68d9a7d6a9103a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.497734:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bce7b14/0xdf68d9a7d6a9103a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.497825:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bce7b14/0xdf68d9a7d6a9103a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.497889:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772259.498682:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.498689:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6138802/0xdf68d9a7d6a91041 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.498700:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.498704:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.498716:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6138802/0xdf68d9a7d6a91041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.498727:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6138802/0xdf68d9a7d6a91041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.498736:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6138802/0xdf68d9a7d6a91041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.498755:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6138802/0xdf68d9a7d6a91041 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.501279:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772259.501305:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bce7b14/0xdf68d9a7d6a9103a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.501318:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.501324:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bce7b14/0xdf68d9a7d6a9103a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.501335:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bce7b14/0xdf68d9a7d6a9103a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.501355:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bce7b14/0xdf68d9a7d6a9103a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.501363:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bce7b14/0xdf68d9a7d6a9103a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.501386:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.501390:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6138802/0xdf68d9a7d6a91041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.501407:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327e00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.501411:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6138802/0xdf68d9a7d6a91041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.501418:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6138802/0xdf68d9a7d6a91041 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.501440:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6138802/0xdf68d9a7d6a91041 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.501448:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.501450:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.501452:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772259.503518:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.515927:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790772259.515962:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6138802/0xdf68d9a7d6a91041 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772259.516729:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.516738:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91048 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.516887:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.516892:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.516898:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.516913:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.517146:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.517155:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91048 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.517581:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.517589:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.517598:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.517602:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.517612:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.517630:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91048 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.517639:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.517641:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.517643:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.524894:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790772259.524910:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91048 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772259.527830:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.527841:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87b831d/0xdf68d9a7d6a9104f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.527858:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.527862:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.527868:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c87b831d/0xdf68d9a7d6a9104f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.527881:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c87b831d/0xdf68d9a7d6a9104f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.527891:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87b831d/0xdf68d9a7d6a9104f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.527912:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c87b831d/0xdf68d9a7d6a9104f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.527942:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772259.527961:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772259.527967:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c87b831d/0xdf68d9a7d6a9104f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.527975:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772259.527980:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87b831d/0xdf68d9a7d6a9104f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.527989:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87b831d/0xdf68d9a7d6a9104f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528005:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c87b831d/0xdf68d9a7d6a9104f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528012:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c87b831d/0xdf68d9a7d6a9104f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528027:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.528029:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.528031:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.528456:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.528469:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d879e703/0xdf68d9a7d6a91056 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528477:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.528480:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.528484:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d879e703/0xdf68d9a7d6a91056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528493:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d879e703/0xdf68d9a7d6a91056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528501:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d879e703/0xdf68d9a7d6a91056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528508:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d879e703/0xdf68d9a7d6a91056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528521:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772259.528530:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772259.528533:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d879e703/0xdf68d9a7d6a91056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528539:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326c00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772259.528542:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d879e703/0xdf68d9a7d6a91056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528576:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d879e703/0xdf68d9a7d6a91056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528595:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d879e703/0xdf68d9a7d6a91056 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528603:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d879e703/0xdf68d9a7d6a91056 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.528616:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.528618:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.528620:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.529006:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.529012:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9105d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.529021:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.529023:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.529028:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9105d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.529037:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9105d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.529044:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9105d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.529051:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9105d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.529076:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772259.529084:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772259.529088:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9105d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.529094:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326a00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772259.529097:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9105d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.529104:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9105d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.529114:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9105d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.529141:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9105d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.529155:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.529157:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.529159:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.532914:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.532941:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91064 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.533041:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.533059:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.533066:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.534923:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.535083:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.535093:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91064 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.535215:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772259.537541:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772259.537571:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91064 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.537584:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772259.537589:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91064 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.537600:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91064 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.537620:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91064 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.537647:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91064 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.537671:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.537673:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.537675:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.538636:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.538645:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a9106b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.538658:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.538662:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.538669:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a9106b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.538680:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a9106b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.538689:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a9106b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.538698:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a9106b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.538724:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772259.538847:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.538854:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a9106b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.538874:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.538878:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a9106b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.538887:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a9106b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.538900:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a9106b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.538908:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039f2e506/0xdf68d9a7d6a9106b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.538926:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.538928:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.538941:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.540696:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.540713:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a91072 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.540729:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.540733:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.540738:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a91072 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.541485:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a91072 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.541495:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a91072 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.541502:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a91072 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.541612:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772259.543442:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.543454:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a91079 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.543469:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.543473:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.543479:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a91079 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.543492:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a91079 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.543509:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a91079 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.543517:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a91079 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.545885:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772259.545900:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a91072 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.545912:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.545917:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a91072 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.545928:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a91072 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.545972:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a91072 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.545980:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a91072 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.546008:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.546011:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a91079 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.546017:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.546021:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a91079 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.546029:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a91079 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.546039:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a91079 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.546046:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.546047:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.546049:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.548217:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790772259.548229:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a91079 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772259.552271:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.552282:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a91080 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.552299:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.552303:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.552309:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a91080 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.552323:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a91080 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.552333:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a91080 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.552352:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a91080 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.552364:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772259.552996:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.553003:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a91087 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.553013:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.553016:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.553021:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a91087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.553031:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a91087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.553038:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a91087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.553046:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a91087 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.553055:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790772259.553520:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772259.553529:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a91080 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.553566:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.553570:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a91080 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.553580:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a91080 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.553598:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a91080 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.553606:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a91080 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.553625:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.553628:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a91087 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.553634:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2a00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.553636:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a91087 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.553643:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a91087 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.553652:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a91087 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.553664:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a91087 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.553677:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.553678:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.553680:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772259.557185:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.557728:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.558051:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9108e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.558147:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.558153:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.558159:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9108e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.558174:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9108e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.558184:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9108e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.558193:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9108e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.558253:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772259.564372:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.564386:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9108e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.564399:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2e00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.564404:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9108e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.564415:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9108e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.564436:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9108e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.564442:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f2c6615/0xdf68d9a7d6a9108e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772259.578426:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.578440:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d55f48ef/0xdf68d9a7d6a91095 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.578458:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.578462:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.578468:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d55f48ef/0xdf68d9a7d6a91095 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.578482:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d55f48ef/0xdf68d9a7d6a91095 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.578508:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d55f48ef/0xdf68d9a7d6a91095 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.578516:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d55f48ef/0xdf68d9a7d6a91095 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.578535:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772259.578572:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1790772259.579401:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.579409:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a9109c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.579421:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.579424:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.579428:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a9109c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.579438:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a9109c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.579447:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a9109c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.579455:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a9109c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.579475:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772259.582304:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.582316:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a910a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.582332:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.582336:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.582342:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a910a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.582353:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a910a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.582362:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a910a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.582370:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a910a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.582380:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790772259.585277:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772259.585290:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a9109c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.585317:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.585322:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a9109c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.585333:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a9109c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.585354:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a9109c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.585361:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1b85d4/0xdf68d9a7d6a9109c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.585379:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.585383:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a910a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.585389:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.585392:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a910a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772259.585670:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.585678:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a910aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.585689:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.585700:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.585706:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a910aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.585718:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a910aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.585728:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a910aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.585736:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a910aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.586221:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a910a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.586856:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772259.587036:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a910a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.587052:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f17aaf3b/0xdf68d9a7d6a910a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.587266:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.587271:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a910aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.587279:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.587283:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a910aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.587292:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a910aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.587304:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a910aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.587310:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2eb85f9/0xdf68d9a7d6a910aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.587323:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.587325:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.587326:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.589259:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.589269:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a910b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.589284:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.589288:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.589294:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a910b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.589306:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a910b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.589317:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a910b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.589332:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a910b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.589359:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772259.589470:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772259.589477:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a910b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.589490:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2a00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772259.589494:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a910b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.589503:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a910b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.589520:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a910b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.589528:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016409ebe/0xdf68d9a7d6a910b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.589546:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772259.589567:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772259.589569:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.590379:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.590386:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a910b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.590397:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.590595:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.590600:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a910b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.590612:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a910b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.590622:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a910b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.590630:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a910b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.590643:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772259.590822:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772259.590828:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a910b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.590836:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772259.590840:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a910b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.590858:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a910b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.590880:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a910b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.590888:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b94c58d/0xdf68d9a7d6a910b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.590905:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772259.590907:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772259.590908:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.595816:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.595829:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a910bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.595851:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.595856:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.595862:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a910bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.595877:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a910bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.595887:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a910bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.595896:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a910bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.595915:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772259.598238:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.598251:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a910bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.598274:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.598279:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a910bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.598292:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a910bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.598313:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a910bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.598321:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003042bdff/0xdf68d9a7d6a910bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.598344:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.598346:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.598348:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.598463:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d55f48ef/0xdf68d9a7d6a91095 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.598473:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a3c00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772259.598477:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d55f48ef/0xdf68d9a7d6a91095 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.598485:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d55f48ef/0xdf68d9a7d6a91095 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.598508:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d55f48ef/0xdf68d9a7d6a91095 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.598516:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d55f48ef/0xdf68d9a7d6a91095 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.598531:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.598533:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772259.598535:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.598614:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.598620:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a910c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.598632:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.598636:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.598643:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a910c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.598653:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a910c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.598662:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a910c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.598669:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a910c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.598697:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790772259.599589:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.599596:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a910c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.599606:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2414a2000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.599610:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a910c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.599619:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a910c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.599642:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a910c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.599649:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000461e4306/0xdf68d9a7d6a910c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.599663:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.599665:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.599667:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772259.599675:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.599727:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.599734:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a910cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.599828:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.599831:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.599835:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a910cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.599845:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a910cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.599855:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a910cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.599862:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a910cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.599886:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772259.599926:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772259.599932:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a910cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.599940:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772259.599943:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a910cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.599951:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a910cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.599961:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a910cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.599969:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e15ca42/0xdf68d9a7d6a910cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.599994:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772259.599995:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772259.599997:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772259.607254:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772259.607268:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a910d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.607285:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1790772259.607299:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772259.607305:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a910d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.607319:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a910d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.607329:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a910d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.607337:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a910d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772259.607672:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790772259.608762:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790772259.608770:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a910db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.608784:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1790772259.608787:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772259.608793:0:15031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a910db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.608804:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a910db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.608812:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a910db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772259.608820:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a910db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.610045:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772259.610057:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a910d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.610068:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326a00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.610072:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a910d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.610093:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a910d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.610113:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a910d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.610131:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a910d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.612535:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772259.612559:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a910db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.612573:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9ab800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772259.612578:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a910db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.612591:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a910db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.612608:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a910db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772259.612616:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.612630:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772259.612634:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772259.613184:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790772259.613193:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db27133d/0xdf68d9a7d6a910db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1790772259.614003:0:15031:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1790772259.614368:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14369:x1877760428568448:12345-0@lo:5:osp-pre-0-0.0 Request processed in 187362us (187522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772259.614388:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790772259.614424:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790772259.616998:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1790772259.617278:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14369:1877760428568448:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790772259.617295:0:14369:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1790772259.617380:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14369:1877760428568576:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790772259.617656:0:14369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772259.617826:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428568576 00000100:00100000:3.0:1790772259.617833:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428568576 00000100:00100000:1.0:1790772259.618022:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25089a600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772259.618063:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772259.618373:0:15032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14369:x1877760428568576:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790772259.618480:0:15032:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1790772259.632481:0:15032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14369:x1877760428568576:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14400us (14816us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790772259.632494:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772259.632648:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14369:1877760428568576:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790772259.632662:0:14369:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:2.0:1790772259.953637:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1790772259.953655:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790772260.127688:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772261.154365:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772262.175705:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772263.201875:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772264.230866:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790772264.255983:0:15752:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790772264.255986:0:15752:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790772264.256090:0:15752:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df258961800 00000020:01000004:3.0:1790772264.256117:0:15752:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790772264.256129:0:15752:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790772264.256152:0:15752:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8df248b3cd40) 00000020:00000080:3.0:1790772264.256169:0:15752:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790772264.271090:0:15752:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790772264.271362:0:15752:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790772264.272150:0:15752:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790772264.272356:0:15752:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790772264.272711:0:15752:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790772264.273067:0:15752:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 231: rc = 0 00100000:10000000:2.0:1790772264.273189:0:15752:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 231: rc = 0 00100000:10000000:2.0:1790772264.273278:0:15752:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 231: rc = 0 00100000:10000000:2.0:1790772264.273750:0:15752:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 622: rc = 0 00100000:10000000:2.0:1790772264.274048:0:15752:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 622: rc = 0 00100000:10000000:2.0:1790772264.274288:0:15752:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 622: rc = 0 00100000:10000000:2.0:1790772264.274691:0:15752:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 622: rc = 0 00100000:10000000:2.0:1790772264.274925:0:15752:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 622: rc = 0 00100000:10000000:2.0:1790772264.275174:0:15752:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 622: rc = 0 00000020:00000080:2.0:1790772264.275813:0:15752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790772264.275824:0:15752:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790772264.275834:0:15752:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdf68d9a7d6a910e9 00000020:01000004:2.0:1790772264.275841:0:15752:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790772264.275866:0:15752:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790772264.275869:0:15752:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790772264.275874:0:15752:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790772264.275896:0:15752:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790772264.275899:0:15752:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790772264.284868:0:15752:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790772264.284913:0:15752:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.127@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790772264.284918:0:15752:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790772264.284920:0:15752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790772264.284921:0:15752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772264.284922:0:15752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772264.284923:0:15752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772264.284924:0:15752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772264.284925:0:15752:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772264.284927:0:15752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772264.284928:0:15752:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790772264.284932:0:15752:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790772264.284934:0:15752:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790772264.284935:0:15752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790772264.284936:0:15752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772264.284937:0:15752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772264.284938:0:15752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772264.284939:0:15752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772264.284940:0:15752:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772264.284941:0:15752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772264.284942:0:15752:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790772264.284966:0:15752:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790772264.284986:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428568704:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790772264.285054:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.285183:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2460a69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772264.285231:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428568704 00000100:00100000:0.0:1790772264.285239:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428568704 00000100:00100000:0.0:1790772264.285318:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790772264.285329:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15752:x1877760428568704:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790772264.285359:0:14340:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790772264.285362:0:14340:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790772264.285365:0:14340:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790772264.290355:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15752:x1877760428568704:12345-0@lo:253:mount.lustre.0 Request processed in 5019us (5291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772264.290369:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790772264.290598:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428568704:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790772264.290614:0:15752:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790772264.290618:0:15752:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772264.290619:0:15752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790772264.290632:0:15752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772264.290634:0:15752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772264.290635:0:15752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772264.290637:0:15752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772264.290638:0:15752:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772264.290640:0:15752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772264.290641:0:15752:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790772264.290662:0:15752:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df258961800 from lustre-OST0001 10000000:01000000:2.0:1790772264.290689:0:15752:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790772264.290692:0:15752:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790772264.290699:0:15752:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df2581c99c0 local copy 00010000:00010000:2.0:1790772264.290709:0:15752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90e96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772264.290915:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428568832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772264.290950:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.291031:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2460a6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772264.291069:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428568832 00000100:00100000:0.0:1790772264.291076:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428568832 00000100:00100000:0.0:1790772264.291156:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790772264.291165:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15752:x1877760428568832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790772264.291415:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15752:x1877760428568832:12345-0@lo:501:mount.lustre.0 Request processed in 250us (463us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772264.291422:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790772264.291505:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428568832:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790772264.291520:0:15752:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790772264.291696:0:15752:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790772264.291703:0:15752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90e96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772264.291713:0:15752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241326600/0xdf68d9a7d6a90e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a90e96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772264.291735:0:15752:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df258961800 10000000:01000000:3.0:1790772264.291740:0:15752:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790772264.291745:0:15752:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790772264.291747:0:15752:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772264.291751:0:15752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790772264.291754:0:15752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790772264.291776:0:15752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241326c00/0xdf68d9a7d6a910f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772264.291784:0:15752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241326c00/0xdf68d9a7d6a910f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772264.291792:0:15752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241326c00/0xdf68d9a7d6a910f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772264.291807:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428568960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772264.291841:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.295610:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428568960 00000100:00100000:2.0:1790772264.295623:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428568960 00000100:00100000:2.0:1790772264.295668:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790772264.295676:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+16:15752:x1877760428568960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772264.295691:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772264.295707:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a910f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a910f0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.295732:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a910f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a910f0 expref: 17 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.295743:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9abc00/0xdf68d9a7d6a910f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a910f0 expref: 17 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.295752:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9abc00, rc 0) 00000100:00100000:2.0:1790772264.295830:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+17:15752:x1877760428568960:12345-0@lo:101:mount.lustre.0 Request processed in 154us (3987us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.295836:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790772264.296064:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df241377780 going to sleep for 11 seconds 00000100:00100000:3.0:1790772264.296084:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428568960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772264.296112:0:15752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241326c00/0xdf68d9a7d6a910f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a910f7 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772264.296122:0:15752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241326c00/0xdf68d9a7d6a910f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a910f7 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772264.297222:0:15752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790772264.298270:0:15752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772264.298758:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790772264.298806:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790772264.298842:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790772264.298891:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790772264.298931:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790772264.298963:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790772264.299027:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790772264.299035:0:15752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790772264.299133:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772264.299191:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772264.299237:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2413773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772264.299309:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428569088 00000100:00100000:2.0:1790772264.299316:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428569088 00000100:00100000:2.0:1790772264.299362:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790772264.299545:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+17:15752:x1877760428569088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772264.300259:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+17:15752:x1877760428569088:12345-0@lo:501:mount.lustre.0 Request processed in 888us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772264.300269:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790772264.300336:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772264.300442:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772264.300680:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.300746:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2460a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772264.300779:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428569216 00000100:00100000:3.0:1790772264.300785:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428569216 00000100:00100000:3.0:1790772264.300860:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790772264.300869:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+17:15752:x1877760428569216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790772264.301180:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+17:15752:x1877760428569216:12345-0@lo:503:mount.lustre.0 Request processed in 312us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772264.301189:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790772264.301257:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569216:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790772264.302576:0:15752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772264.302657:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772264.302718:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.302910:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2460a6840 going to sleep for 11 seconds 00000100:00100000:0.0:1790772264.303012:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428569344 00000100:00100000:0.0:1790772264.303020:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428569344 00000100:00100000:0.0:1790772264.303054:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790772264.303062:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+17:15752:x1877760428569344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790772264.303330:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+17:15752:x1877760428569344:12345-0@lo:502:mount.lustre.0 Request processed in 268us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772264.303338:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790772264.303613:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772264.303856:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790772264.303906:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790772264.303945:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790772264.304007:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790772264.304059:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790772264.304108:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790772264.304161:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790772264.304201:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790772264.304249:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1790772264.304290:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772264.304338:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.304370:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2460a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1790772264.304576:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428569472 00000100:00100000:3.0:1790772264.304582:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428569472 00000100:00100000:3.0:1790772264.304618:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790772264.304627:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+17:15752:x1877760428569472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772264.304803:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+17:15752:x1877760428569472:12345-0@lo:502:mount.lustre.0 Request processed in 177us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772264.304810:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790772264.304960:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772264.305030:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1790772264.305041:0:15752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1790772264.307162:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790772264.307174:0:15753:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1790772264.307180:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790772264.307182:0:15753:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790772264.307189:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790772264.307204:0:15753:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8df143a519c0) 00000020:00000080:2.0:1790772264.307226:0:15753:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790772264.307232:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790772264.307291:0:15753:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df258961800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790772264.307299:0:15753:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790772264.307306:0:15753:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdf68d9a7d6a91105 00010000:00010000:3.0:1790772264.316775:0:15753:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1790772264.317156:0:15753:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1790772264.323447:0:15753:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790772264.328651:0:15753:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790772264.328663:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772264.328671:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.328673:0:15753:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790772264.328677:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772264.328681:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.328683:0:15753:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790772264.328686:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790772264.328687:0:15753:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790772264.328689:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772264.328692:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.328693:0:15753:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790772264.328695:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772264.328697:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.328698:0:15753:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790772264.328701:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790772264.328761:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772264.328765:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.328767:0:15753:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790772264.328770:0:15753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1790772264.329011:0:15752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1790772264.329040:0:15752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790772264.329067:0:15752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241326c00/0xdf68d9a7d6a910f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a910f7 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772264.329080:0:15752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241326c00/0xdf68d9a7d6a910f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a910f7 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772264.329089:0:15752:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df258961800 from 1 10000000:01000000:0.0:1790772264.329092:0:15752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772264.329136:0:15752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772264.329144:0:15752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772264.329170:0:15752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772264.329193:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790772264.329258:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772264.329303:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26a216c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790772264.329400:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428569600 00000100:00100000:1.0:1790772264.329407:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428569600 00000100:00100000:1.0:1790772264.329456:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790772264.330114:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+17:15752:x1877760428569600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772264.330133:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772264.330148:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b9a00/0xdf68d9a7d6a91113 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a9110c expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772264.330174:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b9a00/0xdf68d9a7d6a91113 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a9110c expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772264.330195:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b9a00/0xdf68d9a7d6a91113 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a9110c expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772264.330203:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9a00, rc 0) 00000100:00100000:1.0:1790772264.330254:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428569600:12345-0@lo:101:mount.lustre.0 Request processed in 791us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772264.330261:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790772264.330313:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790772264.330330:0:15752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772264.330339:0:15752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772264.330836:0:15752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790772264.331262:0:15752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790772264.331499:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790772264.331540:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790772264.331630:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790772264.331639:0:15752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790772264.331698:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772264.331744:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772264.331780:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772264.331805:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428569728 00000100:00100000:1.0:1790772264.331812:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428569728 00000100:00100000:1.0:1790772264.331844:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772264.331851:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428569728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772264.332017:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428569728:12345-0@lo:501:mount.lustre.0 Request processed in 166us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772264.332025:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790772264.332063:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790772264.332086:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772264.332134:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772264.332147:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790772264.332159:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428569856 00000100:00100000:1.0:1790772264.332162:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428569856 00000100:00100000:1.0:1790772264.332180:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790772264.332186:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428569856:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790772264.332422:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428569856:12345-0@lo:503:mount.lustre.0 Request processed in 235us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772264.332429:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790772264.332465:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569856:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790772264.339778:0:15752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790772264.339866:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790772264.339942:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772264.339991:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772264.340178:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428569984 00000100:00100000:2.0:1790772264.340185:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428569984 00000100:00100000:2.0:1790772264.340232:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790772264.340241:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428569984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772264.340499:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428569984:12345-0@lo:502:mount.lustre.0 Request processed in 258us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.340508:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790772264.340629:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428569984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790772264.340856:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790772264.340905:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790772264.340950:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790772264.340983:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790772264.341013:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790772264.341053:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790772264.341083:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790772264.341129:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790772264.341158:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790772264.341198:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772264.341231:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772264.341415:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428570112 00000100:00100000:2.0:1790772264.341421:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428570112 00000100:00100000:2.0:1790772264.341455:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790772264.341470:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428570112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772264.341638:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428570112:12345-0@lo:502:mount.lustre.0 Request processed in 175us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.341649:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790772264.341687:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772264.341763:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790772264.341773:0:15752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790772264.344943:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772264.344953:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.344956:0:15757:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790772264.344963:0:15757:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df258961800 00000020:00000080:1.0:1790772264.344966:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790772264.344972:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772264.344974:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.344986:0:15757:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790772264.344989:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772264.344992:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.344993:0:15757:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790772264.344996:0:15757:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df258961800 00000020:00000080:1.0:1790772264.344998:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790772264.345049:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772264.345052:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.345054:0:15757:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790772264.345056:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772264.345058:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.345060:0:15757:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790772264.345063:0:15757:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df258961800 00000020:00000080:1.0:1790772264.345065:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790772264.345109:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772264.345113:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772264.345114:0:15757:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790772264.345117:0:15757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790772264.353763:0:15752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790772264.353806:0:15752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772264.353839:0:15752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772264.353852:0:15752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772264.353911:0:15752:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790772264.353914:0:15752:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df258961800 10000000:01000000:3.0:1790772264.353918:0:15752:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df258961800 10000000:01000000:3.0:1790772264.353922:0:15752:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772264.353928:0:15752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df258961800 from 1 10000000:01000000:3.0:1790772264.353931:0:15752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790772264.353965:0:15752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241327400/0xdf68d9a7d6a9111a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772264.353973:0:15752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241327400/0xdf68d9a7d6a9111a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772264.353984:0:15752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241327400/0xdf68d9a7d6a9111a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772264.354006:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790772264.354066:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772264.354117:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772264.354193:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428570240 00000100:00100000:2.0:1790772264.354201:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428570240 00000100:00100000:2.0:1790772264.354243:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790772264.354252:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26e571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428570240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790772264.354264:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772264.354276:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9aa800/0xdf68d9a7d6a91121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a9111a expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.354297:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9aa800/0xdf68d9a7d6a91121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a9111a expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.354306:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9aa800/0xdf68d9a7d6a91121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a9111a expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.354313:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa800, rc 0) 00000100:00100000:2.0:1790772264.359871:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26e571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:15752:x1877760428570240:12345-0@lo:101:mount.lustre.0 Request processed in 5612us (5797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.359883:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790772264.363739:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790772264.363772:0:15752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241327400/0xdf68d9a7d6a9111a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a91121 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772264.363785:0:15752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241327400/0xdf68d9a7d6a9111a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a91121 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790772264.364583:0:15752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790772264.364898:0:15752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772264.365169:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790772264.365215:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790772264.365253:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790772264.365303:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790772264.365342:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790772264.368138:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790772264.368224:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790772264.368260:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790772264.368311:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790772264.369987:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790772264.370043:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790772264.370126:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790772264.370165:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790772264.370217:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790772264.370267:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790772264.370305:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790772264.372269:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790772264.372407:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790772264.372448:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790772264.372586:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790772264.372650:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790772264.377164:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790772264.377249:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790772264.377323:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790772264.377389:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790772264.377426:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790772264.377494:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790772264.377532:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790772264.377589:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790772264.377675:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1790772264.377716:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1790772264.377752:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1790772264.377787:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1790772264.377839:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1790772264.377875:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1790772264.377927:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1790772264.377964:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1790772264.378057:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1790772264.378065:0:15752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790772264.378173:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790772264.378244:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772264.378292:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772264.378522:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428570368 00000100:00100000:2.0:1790772264.378530:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428570368 00000100:00100000:2.0:1790772264.378582:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790772264.378592:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26e572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+19:15752:x1877760428570368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772264.378813:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26e572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+19:15752:x1877760428570368:12345-0@lo:501:mount.lustre.0 Request processed in 222us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.378828:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790772264.378871:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790772264.378905:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772264.378945:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.378968:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428570496 00000100:00100000:2.0:1790772264.378972:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428570496 00000100:00100000:2.0:1790772264.378994:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790772264.379000:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26e572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:15752:x1877760428570496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790772264.379274:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26e572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:15752:x1877760428570496:12345-0@lo:503:mount.lustre.0 Request processed in 273us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.379281:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790772264.379313:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27f96e600 going to sleep for 11 seconds 00000100:00100000:2.0:1790772264.379325:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570496:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790772264.379809:0:15752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790772264.379867:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772264.379913:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.379941:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428570624 00000100:00100000:2.0:1790772264.379945:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428570624 00000100:00100000:2.0:1790772264.379971:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790772264.379978:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:15752:x1877760428570624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772264.380220:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:15752:x1877760428570624:12345-0@lo:502:mount.lustre.0 Request processed in 242us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.380227:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790772264.380259:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27f96e600 going to sleep for 11 seconds 00000100:00100000:2.0:1790772264.380275:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772264.380480:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790772264.380524:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790772264.380584:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790772264.380635:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790772264.380673:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790772264.380719:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790772264.380755:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790772264.380791:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790772264.380839:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790772264.380895:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790772264.380928:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790772264.380978:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790772264.381014:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790772264.381049:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790772264.381108:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790772264.381148:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790772264.381182:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790772264.381228:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790772264.381264:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790772264.388183:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790772264.388344:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790772264.388397:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790772264.388435:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790772264.388791:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790772264.388835:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790772264.388901:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790772264.388956:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790772264.388994:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790772264.389030:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790772264.389078:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790772264.389131:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790772264.389179:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790772264.389217:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790772264.389271:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790772264.389308:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790772264.389855:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790772264.389904:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790772264.389941:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790772264.389991:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790772264.390031:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790772264.390077:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772264.390162:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.390212:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428570752 00000100:00100000:2.0:1790772264.390220:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428570752 00000100:00100000:2.0:1790772264.390263:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790772264.390271:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:15752:x1877760428570752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790772264.393814:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:15752:x1877760428570752:12345-0@lo:502:mount.lustre.0 Request processed in 3534us (3643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.393829:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790772264.393964:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df27f96e600 going to sleep for 11 seconds 00000100:00100000:2.0:1790772264.393989:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428570752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790772264.394107:0:15752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790772264.394122:0:15752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1790772264.396781:0:15762:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790772264.396797:0:15762:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8df258e019c0) 00000020:00000080:0.0:1790772264.396821:0:15762:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1790772264.396890:0:15762:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df258961800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790772264.396894:0:15762:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df258961800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790772264.396897:0:15762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df258961800 3 00010000:00080000:0.0:1790772264.396925:0:15762:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df27f91d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.127@tcp at head 00010000:00010000:0.0:1790772264.402734:0:15762:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1790772264.402937:0:15762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790772264.402975:0:15762:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790772264.402989:0:15762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdf68d9a7d6a9112f 00000100:00080000:0.0:1790772264.402998:0:15762:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790772264.403009:0:15762:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df27f91d800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1790772264.403042:0:15762:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27ae0ed80 x1877760428570880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772264.403067:0:15762:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790772264.403500:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1877760428570880:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790772264.403591:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.403679:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428570880 00000100:00100000:2.0:1790772264.403687:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428570880 00000100:00100000:2.0:1790772264.403715:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772264.403721:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1877760428570880:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790772264.403750:0:14348:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:2.0:1790772264.403783:0:14348:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdf68d9a7d6a91136 00000004:00100000:2.0:1790772264.403796:0:14348:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790772264.403822:0:14348:0:(import.c:65:import_set_state_nolock()) ffff8df259086800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772264.403866:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877760428570880:12345-0@lo:38:llog_process_th.0 Request processed in 144us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.403874:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790772264.403936:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27ae0ed80 x1877760428570880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790772274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790772264.403947:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790772264.403955:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1790772264.403962:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790772264.403965:0:3292:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790772264.403967:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df27f91d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790772264.403973:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1877760428570880:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1790772264.405325:0:12647:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790772264.405796:0:12647:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790772264.405800:0:12647:0:(import.c:65:import_set_state_nolock()) ffff8df245b7f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790772264.405806:0:12647:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:1.0:1790772264.405812:0:12647:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790772264.405821:0:12647:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df245b7f000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1790772264.405843:0:12647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df26f3e8700 x1877760428571136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790772264.405901:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428571008:0@lo:400:kworker.0 00000100:00100000:1.0:1790772264.405952:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772264.405984:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790772264.405990:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428571264:0@lo:400:kworker.0 00000100:00100000:1.0:1790772264.406030:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772264.406060:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428571136:0@lo:8:kworker.0 00000100:00100000:1.0:1790772264.406086:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772264.406128:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428571392:0@lo:400:kworker.0 00000100:00100000:1.0:1790772264.406154:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772264.406188:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428571264 00000100:00100000:1.0:1790772264.406194:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428571264 00000100:00100000:1.0:1790772264.406231:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428571392 00000100:00100000:1.0:1790772264.406235:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428571392 00000100:00100000:1.0:1790772264.406260:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772264.406268:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428571264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772264.406316:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428571264:12345-0@lo:400:kworker.0 Request processed in 48us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772264.406322:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772264.406489:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428571008 00000100:00100000:2.0:1790772264.406494:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428571008 00000100:00100000:2.0:1790772264.406523:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428571136 00000100:00100000:2.0:1790772264.406526:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428571136 00000100:00100000:2.0:1790772264.406540:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772264.406569:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428571008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772264.406607:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428571008:12345-0@lo:400:kworker.0 Request processed in 61us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.406614:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772264.406628:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772264.406632:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1877760428571136:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790772264.406687:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1877760428571136:12345-0@lo:8:kworker.0 Request processed in 53us (599us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790772264.406693:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1790772264.407267:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1790772264.408141:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772264.408155:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428571392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772264.408226:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428571392:12345-0@lo:400:kworker.0 Request processed in 76us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772264.408233:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1790772264.408260:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772264.408264:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790772264.408291:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df26f3eb800 x1877760428571264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772264.408305:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428571264:0@lo:400:kworker.0 00000100:00100000:1.0:1790772264.408316:0:3293:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000020:01000000:2.0:1790772264.408647:0:15752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790772264.408679:0:15752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790772264.408696:0:15752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241327400/0xdf68d9a7d6a9111a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a91121 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.408707:0:15752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241327400/0xdf68d9a7d6a9111a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a91121 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790772264.408764:0:15752:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790772264.408780:0:15752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790772264.408781:0:15752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772264.408782:0:15752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772264.408783:0:15752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772264.408785:0:15752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772264.408786:0:15752:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772264.408788:0:15752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772264.408789:0:15752:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790772264.408799:0:15752:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1790772264.408801:0:15752:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790772264.408803:0:15752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790772264.408804:0:15752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772264.408805:0:15752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772264.408806:0:15752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772264.408807:0:15752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772264.408808:0:15752:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772264.408809:0:15752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772264.408809:0:15752:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790772264.408830:0:15752:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790772264.408845:0:15752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428571520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790772264.408905:0:15752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.408933:0:15752:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24518e780 going to sleep for 11 seconds 00000100:00100000:3.0:1790772264.409523:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428571520 00000100:00100000:3.0:1790772264.409532:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428571520 00000100:00100000:3.0:1790772264.409589:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790772264.409598:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:15752:x1877760428571520:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790772264.409622:0:14342:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790772264.409635:0:14342:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1790772264.410607:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df26f3e8a80 x1877760428571392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790772264.410622:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428571392:0@lo:400:kworker.0 00000100:00100000:1.0:1790772264.411603:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428571008:0@lo:400:kworker.0 00000100:00100000:1.0:1790772264.411658:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790772264.411664:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df245b7f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790772264.411669:0:3292:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790772264.411672:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428571136:0@lo:8:kworker.0 20000000:01000000:3.0:1790772264.449867:0:14342:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790772264.449885:0:14342:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790772264.449938:0:14362:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790772264.449943:0:14362:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790772264.449965:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.449984:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241326400/0xdf68d9a7d6a91010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a91009 expref: 19 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.449993:0:14362:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450031:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241326400/0xdf68d9a7d6a91010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a91009 expref: 19 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450046:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df241326400/0xdf68d9a7d6a91010 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a91009 expref: 19 pid: 14342 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772264.450059:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14362:1877760428571648:0@lo:104: 00000100:00100000:2.0:1790772264.450132:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.450180:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24518ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1790772264.450230:0:14331:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428571648 00000100:00100000:3.0:1790772264.450237:0:14331:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428571648 00000100:00100000:3.0:1790772264.450291:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772264.450301:0:14331:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+3:14362:x1877760428571648:12345-0@lo:104: 00010000:00010000:3.0:1790772264.450314:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772264.450361:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790772264.450367:0:14331:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+3:14362:x1877760428571648:12345-0@lo:104: Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772264.450385:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1790772264.450443:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772264.450449:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450457:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1790772264.450461:0:14336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450485:0:14336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790772264.450503:0:14336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790772264.450509:0:14336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790772264.450542:0:14336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450571:0:14336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790772264.450592:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450599:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9aa400/0xdf68d9a7d6a91009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a91010 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450614:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772264.450616:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772264.450618:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772264.450629:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f131dbd3-adf7-4830-81da-ffe0e188139b:3296:1877760428571776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790772264.450658:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772264.450697:0:14334:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428571776 00000100:00100000:2.0:1790772264.450701:0:14334:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428571776 00010000:00010000:2.0:1790772264.450720:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241326400/0xdf68d9a7d6a91010 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a91009 expref: 20 pid: 14342 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772264.450742:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772264.450749:0:14334:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f131dbd3-adf7-4830-81da-ffe0e188139b+20:3296:x1877760428571776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772264.450760:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772264.450765:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241326400/0xdf68d9a7d6a91010 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a91009 expref: 20 pid: 14342 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450782:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241326400/0xdf68d9a7d6a91010 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a91009 expref: 20 pid: 14342 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450796:0:14334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450804:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790772264.450816:0:14334:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002553232s 00010000:00010000:2.0:1790772264.450820:0:14334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450827:0:14334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450834:0:14334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450841:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450846:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa600 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772264.450850:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450857:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450867:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.450882:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772264.450912:0:14334:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f131dbd3-adf7-4830-81da-ffe0e188139b+20:3296:x1877760428571776:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772264.450919:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790772264.450955:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f131dbd3-adf7-4830-81da-ffe0e188139b:3296:1877760428571776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772264.450980:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241326400/0xdf68d9a7d6a91010 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a91009 expref: 19 pid: 14342 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772264.450988:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14362:1877760428571648:0@lo:104: 00010000:00010000:2.0:1790772264.450999:0:14362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.451006:0:14362:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.451012:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772264.451017:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a9113d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772264.462243:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+18:15752:x1877760428571520:12345-0@lo:253:mount.lustre.0 Request processed in 52639us (53329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772264.462256:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790772264.462342:0:15752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f131dbd3-adf7-4830-81da-ffe0e188139b:15752:1877760428571520:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790772264.462357:0:15752:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790772264.462360:0:15752:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790772264.462362:0:15752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790772264.462363:0:15752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790772264.462365:0:15752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790772264.462366:0:15752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790772264.462434:0:15752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790772264.462436:0:15752:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790772264.462438:0:15752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790772264.462439:0:15752:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790772264.462457:0:15752:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790772264.466017:0:15752:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772264.466345:0:15752:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790772264.466876:0:15752:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772264.467005:0:15752:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790772264.467139:0:15752:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790772264.467320:0:15752:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790772264.468135:0:15752:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790772264.518858:0:15752:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790772264.518868:0:15752:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790772264.518899:0:15752:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790772264.518954:0:15752:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790772264.519074:0:15752:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790772264.519114:0:15752:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1790772264.927949:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790772264.927968:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428571904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772264.928024:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772264.928082:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428571904 00000100:00100000:1.0:1790772264.928088:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428571904 00000100:00100000:1.0:1790772264.928141:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772264.928149:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428571904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772264.928180:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772264.928226:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428571904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772264.928233:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790772264.928277:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428571904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790772265.248582:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790772265.760958:0:14344:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790772265.760966:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df27f91f800 from 8 10000000:01000000:3.0:1790772265.760971:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790772265.761012:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241326200/0xdf68d9a7d6a91144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772265.761024:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df241326200/0xdf68d9a7d6a91144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772265.761035:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df241326200/0xdf68d9a7d6a91144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772265.761059:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428572032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790772265.761145:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772265.761207:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a840 going to sleep for 11 seconds 00000100:00100000:0.0:1790772265.767032:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428572032 00000100:00100000:0.0:1790772265.767045:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428572032 00000100:00100000:0.0:1790772265.767104:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790772265.767114:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+18:14344:x1877760428572032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772265.767131:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772265.767154:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240030600/0xdf68d9a7d6a9114b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a91144 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772265.767180:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240030600/0xdf68d9a7d6a9114b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a91144 expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772265.767201:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240030600/0xdf68d9a7d6a9114b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a91144 expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772265.767211:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030600, rc 0) 00000100:00100000:0.0:1790772265.767279:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+19:14344:x1877760428572032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (6134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772265.767286:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790772265.767348:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428572032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772265.767378:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df241326200/0xdf68d9a7d6a91144 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a9114b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772265.767387:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df241326200/0xdf68d9a7d6a91144 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a9114b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772265.767464:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428572160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790772265.767506:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772265.767534:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26a2160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790772265.767579:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428572160 00000100:00100000:0.0:1790772265.767584:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428572160 00000100:00100000:0.0:1790772265.767608:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790772265.767614:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:14344:x1877760428572160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790772265.767628:0:14342:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790772265.767644:0:14342:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790772265.767647:0:14342:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1790772265.767718:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:14344:x1877760428572160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772265.767725:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790772265.767770:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428572160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790772265.767819:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790772265.767827:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df241326200/0xdf68d9a7d6a91144 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a9114b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772265.767835:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df241326200/0xdf68d9a7d6a91144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a9114b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772266.274133:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790772266.977383:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790772267.295671:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772268.320240:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772269.352290:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790772269.537063:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790772269.537079:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790772269.537082:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df245b7f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790772269.537097:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df245b7f000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:2.0:1790772269.537119:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27401fb80 x1877760428572544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790772269.537172:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428572800:0@lo:400:kworker.0 00000100:00100000:2.0:1790772269.537235:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772269.537287:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790772269.537293:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428572288:0@lo:400:kworker.0 00000100:00100000:2.0:1790772269.537329:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772269.537352:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428572928:0@lo:400:kworker.0 00000100:00100000:2.0:1790772269.537384:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772269.537408:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428572416:0@lo:400:kworker.0 00000100:00100000:2.0:1790772269.537433:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772269.537468:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790772269.537473:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428572672:0@lo:400:kworker.0 00000100:00100000:2.0:1790772269.537497:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772269.537526:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428572288 00000100:00100000:2.0:1790772269.537533:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428572288 00000100:00100000:2.0:1790772269.537594:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790772269.537602:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3293:x1877760428572288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772269.537650:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3293:x1877760428572288:12345-0@lo:400:kworker.0 Request processed in 48us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772269.537657:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790772269.537686:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428572416 00000100:00100000:2.0:1790772269.537690:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428572416 00000100:00100000:2.0:1790772269.537722:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772269.537728:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428572416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772269.537766:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428572416:12345-0@lo:400:kworker.0 Request processed in 38us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772269.537771:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772269.537811:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428572416:0@lo:400:kworker.0 00000100:00100000:2.0:1790772269.537835:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428572288:0@lo:400:kworker.0 00000100:00100000:1.0:1790772269.538597:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428572544:0@lo:8:kworker.0 00000100:00100000:1.0:1790772269.538634:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772269.538669:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428572800 00000100:00100000:1.0:1790772269.538674:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428572800 00000100:00100000:1.0:1790772269.538700:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428572928 00000100:00100000:1.0:1790772269.538702:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428572928 00000100:00100000:1.0:1790772269.538713:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428572672 00000100:00100000:1.0:1790772269.538724:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428572672 00000100:00100000:1.0:1790772269.538739:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772269.538744:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428572800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772269.538789:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428572800:12345-0@lo:400:kworker.0 Request processed in 44us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772269.538796:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772269.538808:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772269.538813:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428572928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772269.538836:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428572928:12345-0@lo:400:kworker.0 Request processed in 23us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772269.538841:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772269.538850:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790772269.538854:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428572672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772269.538881:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428572672:12345-0@lo:400:kworker.0 Request processed in 26us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772269.538887:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1790772269.538907:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772269.538911:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790772269.538938:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27401d880 x1877760428572672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772269.538951:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428572672:0@lo:400:kworker.0 00010000:00080000:1.0:1790772269.538979:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27401dc00 x1877760428572928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772269.538988:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428572928:0@lo:400:kworker.0 00010000:00080000:1.0:1790772269.538997:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27401f100 x1877760428572800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772269.539013:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428572800:0@lo:400:kworker.0 00000100:00100000:2.0:1790772269.541456:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428572544 00000100:00100000:2.0:1790772269.541471:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428572544 00000100:00100000:2.0:1790772269.541506:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772269.541513:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1877760428572544:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790772269.541543:0:15029:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1790772269.541592:0:15029:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf68d9a7d6a91152 00002000:00100000:2.0:1790772269.541608:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8df259085800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790772269.541624:0:15029:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790772269.541627:0:15029:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790772269.541929:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790772269.541952:0:15029:0:(import.c:65:import_set_state_nolock()) ffff8df259086000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772269.542037:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1877760428572544:12345-0@lo:8:kworker.0 Request processed in 523us (3401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772269.542528:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790772269.544109:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27401fb80 x1877760428572544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790772294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790772269.544137:0:3292:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790772269.544149:0:3292:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790772269.544176:0:3292:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790772269.544181:0:3292:0:(import.c:65:import_set_state_nolock()) ffff8df245b7f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790772269.544294:0:14371:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000004:00080000:0.0:1790772269.544299:0:3292:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790772269.544313:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1877760428572544:0@lo:8:kworker.0 00000100:00100000:3.0:1790772269.544342:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14371:1877760428573184:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790772269.544429:0:14371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772269.544457:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2520bf6c0 going to sleep for 11 seconds 00000004:00080000:2.0:1790772269.544825:0:14370:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1790772269.544864:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428573056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772269.544908:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772269.544959:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428573056 00000100:00100000:1.0:1790772269.544966:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428573056 00000100:00100000:1.0:1790772269.545022:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772269.545034:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1877760428573056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772269.545089:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772269.545093:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428573184 00000100:00100000:3.0:1790772269.545100:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428573184 00000100:00100000:3.0:1790772269.545158:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790772269.545169:0:15032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14371:x1877760428573184:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790772269.545176:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428573056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772269.545185:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790772269.545214:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790772269.545241:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27f9c5880 x1877760428573056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790772285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772269.545259:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428573056:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1790772269.545604:0:14370:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 435690052634ns, next at 0ns, rc = 0 00002000:00080000:3.0:1790772269.563866:0:15032:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790772269.563879:0:15032:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1790772269.563886:0:15032:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1790772269.580156:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.580168:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87b831d/0xdf68d9a7d6a91159 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.580185:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.580189:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.580195:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c87b831d/0xdf68d9a7d6a91159 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.580293:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c87b831d/0xdf68d9a7d6a91159 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.580306:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87b831d/0xdf68d9a7d6a91159 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.580315:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c87b831d/0xdf68d9a7d6a91159 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.580337:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772269.580417:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772269.580424:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c87b831d/0xdf68d9a7d6a91159 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.580447:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772269.580452:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87b831d/0xdf68d9a7d6a91159 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.580461:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87b831d/0xdf68d9a7d6a91159 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.580478:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c87b831d/0xdf68d9a7d6a91159 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.580577:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c87b831d/0xdf68d9a7d6a91159 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.580597:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.580599:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.580600:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.581157:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.581164:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91160 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.581176:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.581179:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.581184:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91160 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.581193:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91160 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.581209:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91160 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.582126:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91160 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.582154:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772269.582173:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772269.582178:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91160 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.582186:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772269.582190:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91160 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.582200:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91160 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.582228:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91160 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.582235:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f96b2c22/0xdf68d9a7d6a91160 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.582255:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.582264:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.582266:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.583096:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.583105:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6138802/0xdf68d9a7d6a91167 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.583118:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.583122:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.583128:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6138802/0xdf68d9a7d6a91167 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.583139:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6138802/0xdf68d9a7d6a91167 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.583148:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6138802/0xdf68d9a7d6a91167 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.583156:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6138802/0xdf68d9a7d6a91167 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.583177:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772269.583191:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772269.583195:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6138802/0xdf68d9a7d6a91167 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.583203:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327e00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772269.583207:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6138802/0xdf68d9a7d6a91167 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.583226:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6138802/0xdf68d9a7d6a91167 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.583240:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6138802/0xdf68d9a7d6a91167 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.583247:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6138802/0xdf68d9a7d6a91167 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.583263:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.583265:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.583266:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.584125:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.584132:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed61765c/0xdf68d9a7d6a9116e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.584144:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.584147:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.584152:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed61765c/0xdf68d9a7d6a9116e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.584163:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed61765c/0xdf68d9a7d6a9116e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.584172:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed61765c/0xdf68d9a7d6a9116e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.584187:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed61765c/0xdf68d9a7d6a9116e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.584283:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772269.584299:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772269.584305:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed61765c/0xdf68d9a7d6a9116e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.584312:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327600 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772269.584316:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed61765c/0xdf68d9a7d6a9116e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.584325:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed61765c/0xdf68d9a7d6a9116e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.584778:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed61765c/0xdf68d9a7d6a9116e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.584787:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed61765c/0xdf68d9a7d6a9116e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.584805:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.584807:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.584809:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.585775:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.585793:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006274defa/0xdf68d9a7d6a91175 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.585806:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.585810:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.585816:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006274defa/0xdf68d9a7d6a91175 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.585827:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006274defa/0xdf68d9a7d6a91175 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.585838:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006274defa/0xdf68d9a7d6a91175 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.585846:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006274defa/0xdf68d9a7d6a91175 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.585862:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772269.585872:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772269.585877:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006274defa/0xdf68d9a7d6a91175 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.585884:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772269.585888:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006274defa/0xdf68d9a7d6a91175 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.585895:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006274defa/0xdf68d9a7d6a91175 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.585915:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006274defa/0xdf68d9a7d6a91175 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.585921:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006274defa/0xdf68d9a7d6a91175 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.585936:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.585937:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.585939:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.587900:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.587912:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9117c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.587927:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.587931:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.587936:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9117c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.587948:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9117c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.587958:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9117c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.587965:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9117c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.588004:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.588103:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.588110:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9117c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.588118:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241326a00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.588121:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9117c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.588130:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9117c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.588147:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9117c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.588155:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000658fcbd2/0xdf68d9a7d6a9117c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.588172:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.588179:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.588181:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.589183:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.589192:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91183 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589205:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.589208:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.589213:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91183 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589225:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91183 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589235:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91183 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589243:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91183 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589261:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772269.589273:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772269.589278:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91183 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589285:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241327800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772269.589297:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91183 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589306:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91183 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589319:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91183 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589327:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e15ca42/0xdf68d9a7d6a91183 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589342:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.589344:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.589359:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.589849:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.589856:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9118a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589866:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.589870:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.589873:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9118a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589883:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9118a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589892:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9118a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589906:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9118a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589922:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772269.589933:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772269.589938:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9118a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589945:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8e000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772269.589948:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9118a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589956:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9118a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589968:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9118a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589976:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9118a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.589991:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.589993:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.589994:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.597268:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.597293:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000708483fd/0xdf68d9a7d6a91191 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.597310:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.597315:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.597321:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000708483fd/0xdf68d9a7d6a91191 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.597345:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000708483fd/0xdf68d9a7d6a91191 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.597356:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000708483fd/0xdf68d9a7d6a91191 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.597364:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000708483fd/0xdf68d9a7d6a91191 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.598108:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.598328:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.598336:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000708483fd/0xdf68d9a7d6a91191 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.598347:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8e400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.598351:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000708483fd/0xdf68d9a7d6a91191 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.598361:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000708483fd/0xdf68d9a7d6a91191 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.598381:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000708483fd/0xdf68d9a7d6a91191 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.598389:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000708483fd/0xdf68d9a7d6a91191 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.598414:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.598417:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.598419:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.599121:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.599130:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a91198 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.599142:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.599146:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.599151:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a91198 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.599161:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a91198 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.599178:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a91198 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.599186:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a91198 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.599220:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.599243:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.599249:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a91198 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.599257:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8f400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.599261:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a91198 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.599275:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a91198 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.599288:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a91198 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.599295:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a91198 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.599309:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.599311:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.599313:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.602036:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.602049:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9119f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.602063:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.602077:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.602084:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9119f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.602096:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9119f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.602106:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9119f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.602114:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9119f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.602151:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.602896:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.602904:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9119f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.602913:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8e000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.602917:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9119f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.602927:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9119f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.602944:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9119f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.602974:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a9119f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.602993:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.602995:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.602997:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.606591:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.606616:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f96231/0xdf68d9a7d6a911a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.606635:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.606640:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.606647:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f96231/0xdf68d9a7d6a911a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.606663:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026f96231/0xdf68d9a7d6a911a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.606673:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f96231/0xdf68d9a7d6a911a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.606681:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026f96231/0xdf68d9a7d6a911a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.606705:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.607147:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.607156:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026f96231/0xdf68d9a7d6a911a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.607164:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8f000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.607169:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f96231/0xdf68d9a7d6a911a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.607178:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f96231/0xdf68d9a7d6a911a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.607196:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026f96231/0xdf68d9a7d6a911a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.607203:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f96231/0xdf68d9a7d6a911a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.607223:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.607225:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.607227:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.607305:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.607311:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000489d84f0/0xdf68d9a7d6a911ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.607320:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.607330:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.607334:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000489d84f0/0xdf68d9a7d6a911ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.607344:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000489d84f0/0xdf68d9a7d6a911ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.607353:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000489d84f0/0xdf68d9a7d6a911ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.607360:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000489d84f0/0xdf68d9a7d6a911ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.607392:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.607413:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.607419:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000489d84f0/0xdf68d9a7d6a911ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.607427:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8f600 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.607432:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000489d84f0/0xdf68d9a7d6a911ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.607439:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000489d84f0/0xdf68d9a7d6a911ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.607455:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000489d84f0/0xdf68d9a7d6a911ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.607462:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000489d84f0/0xdf68d9a7d6a911ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.607477:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.607480:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.607481:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.608003:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.608010:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b55206/0xdf68d9a7d6a911b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608019:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.608022:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.608026:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b55206/0xdf68d9a7d6a911b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608035:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b55206/0xdf68d9a7d6a911b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608042:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b55206/0xdf68d9a7d6a911b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608056:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b55206/0xdf68d9a7d6a911b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608083:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.608227:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.608233:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b55206/0xdf68d9a7d6a911b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.608241:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8e800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.608245:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b55206/0xdf68d9a7d6a911b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.608264:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b55206/0xdf68d9a7d6a911b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.608276:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b55206/0xdf68d9a7d6a911b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.608283:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b55206/0xdf68d9a7d6a911b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.608296:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.608297:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.608299:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.608504:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.608510:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608518:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.608521:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.608525:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608534:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608543:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608584:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608605:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772269.608615:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772269.608620:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608633:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8ec00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772269.608636:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608644:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608655:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608662:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.608676:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.608678:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.608679:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.609086:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.609093:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db883d7c/0xdf68d9a7d6a911c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.609102:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.609105:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.609109:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db883d7c/0xdf68d9a7d6a911c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.609117:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db883d7c/0xdf68d9a7d6a911c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.609133:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db883d7c/0xdf68d9a7d6a911c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.609141:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db883d7c/0xdf68d9a7d6a911c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.609154:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.609217:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.609223:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db883d7c/0xdf68d9a7d6a911c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.609230:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8fe00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.609233:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db883d7c/0xdf68d9a7d6a911c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.609241:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db883d7c/0xdf68d9a7d6a911c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.609253:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db883d7c/0xdf68d9a7d6a911c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.609272:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db883d7c/0xdf68d9a7d6a911c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.609286:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.609288:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.609290:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.614035:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.614047:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000981f3fe6/0xdf68d9a7d6a911c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.614064:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.614084:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.614090:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000981f3fe6/0xdf68d9a7d6a911c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.614103:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000981f3fe6/0xdf68d9a7d6a911c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.614112:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000981f3fe6/0xdf68d9a7d6a911c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.614119:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000981f3fe6/0xdf68d9a7d6a911c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.614146:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.614256:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.614264:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000981f3fe6/0xdf68d9a7d6a911c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.614272:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8fa00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.614276:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000981f3fe6/0xdf68d9a7d6a911c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.614284:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000981f3fe6/0xdf68d9a7d6a911c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.614300:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000981f3fe6/0xdf68d9a7d6a911c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.614307:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000981f3fe6/0xdf68d9a7d6a911c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.614326:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.614328:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.614329:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.615006:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.615013:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f70a766b/0xdf68d9a7d6a911d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.615023:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.615026:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.615031:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f70a766b/0xdf68d9a7d6a911d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.615040:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f70a766b/0xdf68d9a7d6a911d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.615047:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f70a766b/0xdf68d9a7d6a911d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.615054:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f70a766b/0xdf68d9a7d6a911d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.615086:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772269.615141:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772269.615155:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f70a766b/0xdf68d9a7d6a911d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.615170:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8f800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772269.615175:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f70a766b/0xdf68d9a7d6a911d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.615197:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f70a766b/0xdf68d9a7d6a911d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.615228:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f70a766b/0xdf68d9a7d6a911d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.615235:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f70a766b/0xdf68d9a7d6a911d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.615273:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.615276:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.615282:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790772269.618932:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1790772269.618960:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.618976:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005232a94d/0xdf68d9a7d6a911d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.618994:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.619006:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.619012:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005232a94d/0xdf68d9a7d6a911d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.619026:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005232a94d/0xdf68d9a7d6a911d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.619037:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005232a94d/0xdf68d9a7d6a911d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.619045:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005232a94d/0xdf68d9a7d6a911d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.619077:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772269.619140:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772269.619152:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005232a94d/0xdf68d9a7d6a911d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.619178:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8e200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772269.619184:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005232a94d/0xdf68d9a7d6a911d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.619261:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005232a94d/0xdf68d9a7d6a911d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.619290:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005232a94d/0xdf68d9a7d6a911d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.619299:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005232a94d/0xdf68d9a7d6a911d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.619332:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.619334:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.619336:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.622771:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.622793:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a615699d/0xdf68d9a7d6a911de lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.622810:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.622815:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.622821:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a615699d/0xdf68d9a7d6a911de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.622835:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a615699d/0xdf68d9a7d6a911de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.622846:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a615699d/0xdf68d9a7d6a911de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.622869:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a615699d/0xdf68d9a7d6a911de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.622897:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.623059:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.623077:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a615699d/0xdf68d9a7d6a911de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.623086:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8ea00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.623090:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a615699d/0xdf68d9a7d6a911de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.623099:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a615699d/0xdf68d9a7d6a911de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.623114:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a615699d/0xdf68d9a7d6a911de lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.623121:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a615699d/0xdf68d9a7d6a911de lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.623144:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.623146:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.623148:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.623914:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.623923:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f3868e1/0xdf68d9a7d6a911e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.623934:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.623937:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.623942:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f3868e1/0xdf68d9a7d6a911e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.623953:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f3868e1/0xdf68d9a7d6a911e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.623961:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f3868e1/0xdf68d9a7d6a911e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.623969:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f3868e1/0xdf68d9a7d6a911e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.623989:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772269.624188:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772269.624204:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f3868e1/0xdf68d9a7d6a911e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.624219:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8fc00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772269.624225:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f3868e1/0xdf68d9a7d6a911e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.624237:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f3868e1/0xdf68d9a7d6a911e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.624277:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f3868e1/0xdf68d9a7d6a911e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.624285:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f3868e1/0xdf68d9a7d6a911e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.624314:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.624317:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.624323:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.624466:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.624473:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799e6095/0xdf68d9a7d6a911ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.625979:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.625983:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.625990:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000799e6095/0xdf68d9a7d6a911ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.626003:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000799e6095/0xdf68d9a7d6a911ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.626015:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799e6095/0xdf68d9a7d6a911ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.626023:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000799e6095/0xdf68d9a7d6a911ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.626047:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790772269.628145:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.628156:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1dfa254/0xdf68d9a7d6a911f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.628173:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.628177:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.628183:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1dfa254/0xdf68d9a7d6a911f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.628194:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1dfa254/0xdf68d9a7d6a911f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.628516:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1dfa254/0xdf68d9a7d6a911f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.628525:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1dfa254/0xdf68d9a7d6a911f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628584:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790772269.628587:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.628592:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000799e6095/0xdf68d9a7d6a911ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628600:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8e600 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.628604:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000799e6095/0xdf68d9a7d6a911ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628625:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000799e6095/0xdf68d9a7d6a911ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628641:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000799e6095/0xdf68d9a7d6a911ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628648:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000799e6095/0xdf68d9a7d6a911ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628667:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.628670:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1dfa254/0xdf68d9a7d6a911f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628676:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8ee00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.628679:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1dfa254/0xdf68d9a7d6a911f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628701:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1dfa254/0xdf68d9a7d6a911f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628711:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1dfa254/0xdf68d9a7d6a911f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628717:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1dfa254/0xdf68d9a7d6a911f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.628740:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.628741:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.628743:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.629189:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.629197:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.629202:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772269.629208:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.629228:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.629234:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.629244:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.629252:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.629260:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.629293:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772269.629325:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772269.629337:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.629351:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8ec00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772269.629358:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.629370:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.629393:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.629401:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051fde47a/0xdf68d9a7d6a911fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.629457:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.629462:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.629465:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.630019:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.630028:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ab7bc1/0xdf68d9a7d6a91201 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.630039:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.630043:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.630047:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ab7bc1/0xdf68d9a7d6a91201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.630056:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ab7bc1/0xdf68d9a7d6a91201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.630064:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ab7bc1/0xdf68d9a7d6a91201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.630083:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ab7bc1/0xdf68d9a7d6a91201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.630105:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790772269.630206:0:14335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790772269.630213:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ab7bc1/0xdf68d9a7d6a91201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.630221:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8f200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772269.630225:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ab7bc1/0xdf68d9a7d6a91201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.630235:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ab7bc1/0xdf68d9a7d6a91201 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.630249:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ab7bc1/0xdf68d9a7d6a91201 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.630257:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ab7bc1/0xdf68d9a7d6a91201 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772269.630275:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.630277:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772269.630278:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.631080:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.631089:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a91208 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.631100:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.631110:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.631116:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a91208 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.631127:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a91208 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.631137:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a91208 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.631145:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a91208 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.631169:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772269.631385:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772269.631403:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a91208 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.631417:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8e000 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772269.631423:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a91208 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.631436:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a91208 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.631458:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a91208 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.631466:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d34a686/0xdf68d9a7d6a91208 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.631496:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.631498:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.631500:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790772269.635715:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790772269.635728:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a9120f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.635745:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1790772269.635749:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772269.635755:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a9120f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.635769:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a9120f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.635779:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a9120f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.635795:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a9120f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772269.635819:0:15032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790772269.635867:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790772269.635882:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a9120f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.635910:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8f400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772269.635917:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a9120f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.635928:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a9120f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.635954:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a9120f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.635963:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c7fadf1/0xdf68d9a7d6a9120f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772269.635999:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.636003:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772269.636008:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790772269.636051:0:15032:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1790772269.636159:0:15032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14371:x1877760428573184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 90991us (91727us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772269.636169:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772269.636241:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14371:1877760428573184:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790772269.636261:0:14371:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1790772269.636330:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14371:1877760428573312:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790772269.636390:0:14371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772269.636474:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790772269.636653:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428573312 00000100:00100000:2.0:1790772269.636662:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428573312 00000100:00100000:2.0:1790772269.636733:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790772269.636754:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14371:x1877760428573312:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1790772269.636809:0:15031:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1790772269.647310:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14371:x1877760428573312:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10548us (10907us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790772269.647332:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790772269.647434:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14371:1877760428573312:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790772269.647454:0:14371:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1790772270.062891:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772270.062921:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428573440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772270.063013:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772270.063131:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428573440 00000100:00100000:1.0:1790772270.063140:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428573440 00000100:00100000:1.0:1790772270.063195:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772270.063205:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428573440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772270.063252:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772270.063303:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428573440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772270.063321:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772270.063526:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428573440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790772270.369769:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772271.392263:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790772272.327901:0:16105:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790772272.420975:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772273.444115:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772274.464529:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772274.655781:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428573568:0@lo:400:kworker.0 00000100:00100000:1.0:1790772274.655853:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772274.655897:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428574080:0@lo:400:kworker.0 00000100:00100000:1.0:1790772274.655927:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772274.655964:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428574080 00000100:00100000:1.0:1790772274.655965:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790772274.655974:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428574080 00000100:00100000:1.0:1790772274.655974:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428573696:0@lo:400:kworker.0 00000100:00100000:1.0:1790772274.656005:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772274.656027:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428574208:0@lo:400:kworker.0 00000100:00100000:2.0:1790772274.656058:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772274.656064:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772274.656073:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428574080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772274.656094:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428573824:0@lo:400:kworker.0 00000100:00100000:3.0:1790772274.656111:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428573696 00000100:00100000:3.0:1790772274.656115:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428573696 00000100:00100000:2.0:1790772274.656145:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877760428574080:12345-0@lo:400:kworker.0 Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772274.656148:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772274.656150:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790772274.656162:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790772274.656164:0:15032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428573696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772274.656169:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428574336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790772274.656193:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428574208 00000100:00100000:1.0:1790772274.656193:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772274.656199:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428574208 00000100:00100000:3.0:1790772274.656201:0:15032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428573696:12345-0@lo:400:kworker.0 Request processed in 41us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772274.656210:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772274.656211:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772274.656218:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428573952:0@lo:400:kworker.0 00000100:00100000:3.0:1790772274.656225:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428573824 00000100:00100000:2.0:1790772274.656228:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790772274.656230:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428573824 00000100:00100000:2.0:1790772274.656240:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428574208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772274.656241:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772274.656252:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790772274.656260:0:15032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428573824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772274.656270:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428573568 00000100:00100000:1.0:1790772274.656273:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428573568 00000100:00100000:2.0:1790772274.656289:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428574208:12345-0@lo:400:kworker.0 Request processed in 51us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772274.656297:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790772274.656304:0:15032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428573824:12345-0@lo:400:kworker.0 Request processed in 45us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772274.656304:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790772274.656313:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772274.656313:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3293:x1877760428573568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772274.656314:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428573952 00000100:00100000:2.0:1790772274.656320:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428573952 00000100:00100000:2.0:1790772274.656350:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790772274.656355:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3293:x1877760428573568:12345-0@lo:400:kworker.0 Request processed in 41us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772274.656360:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428573952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772274.656377:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1790772274.656406:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772274.656409:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772274.656411:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772274.656431:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428574336 00000100:00100000:1.0:1790772274.656434:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428574336 00000100:00100000:1.0:1790772274.656471:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772274.656478:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428574336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790772274.656501:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772274.656532:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877760428574336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772274.656538:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772274.656607:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428573824:0@lo:400:kworker.0 00000100:00100000:1.0:1790772274.656620:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428574336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790772274.656648:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428573696:0@lo:400:kworker.0 00010000:00080000:1.0:1790772274.656659:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3e8e00 x1877760428574208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772274.656668:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428574208:0@lo:400:kworker.0 00000100:00100000:1.0:1790772274.656676:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428573568:0@lo:400:kworker.0 00010000:00080000:1.0:1790772274.656685:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3e9500 x1877760428574080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772274.656693:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1877760428574080:0@lo:400:kworker.0 00000100:00100000:2.0:1790772274.658873:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428573952:12345-0@lo:400:kworker.0 Request processed in 2507us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772274.658888:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1790772274.660907:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26f3eb480 x1877760428573952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790772290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790772274.660933:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428573952:0@lo:400:kworker.0 00000001:00080000:2.0:1790772274.784217:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1790772274.784240:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790772274.840396:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772274.840662:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412851200 00000100:00100000:2.0:1790772274.840672:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412851200 00000100:00100000:2.0:1790772274.840716:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:2.0:1790772274.840723:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2346:x1877760412851200:12345-192.168.206.27@tcp:250:mount.lustre.0 00010000:00080000:2.0:1790772274.840751:0:14340:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 52d3e879-983d-44e7-9b45-0d4f9cc178a2@192.168.206.27@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1790772274.840778:0:14340:0:(genops.c:1384:class_connect()) connect: client 52d3e879-983d-44e7-9b45-0d4f9cc178a2, cookie 0xdf68d9a7d6a91216 00000100:00080000:2.0:1790772274.840919:0:14340:0:(import.c:65:import_set_state_nolock()) ffff8df259084000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790772274.840985:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+5:2346:x1877760412851200:12345-192.168.206.27@tcp:250:mount.lustre.0 Request processed in 260us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772274.840992:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:0.0:1790772274.856062:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772274.856153:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412851328 00000100:00100000:1.0:1790772274.856162:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412851328 00000100:00100000:1.0:1790772274.856215:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:1.0:1790772274.856224:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+5:13719:x1877760412851328:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790772274.856239:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772274.856254:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b9600/0xdf68d9a7d6a9121d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d92 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772274.856283:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b9600/0xdf68d9a7d6a9121d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d92 expref: 6 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772274.856294:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b9600/0xdf68d9a7d6a9121d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d92 expref: 6 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772274.856303:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9600, rc 0) 00000100:00100000:1.0:1790772274.856381:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+6:13719:x1877760412851328:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 151us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772274.856389:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:3.0:1790772274.869744:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772274.873060:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412851456 00000100:00100000:1.0:1790772274.873077:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412851456 00000100:00100000:1.0:1790772274.873153:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 76 00000100:00100000:1.0:1790772274.873165:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+6:13719:x1877760412851456:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790772274.873981:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+6:13719:x1877760412851456:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 814us (4240us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790772274.874004:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 76 00000100:00100000:3.0:1790772274.884976:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772274.885085:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412851584 00000100:00100000:2.0:1790772274.885095:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412851584 00000100:00100000:2.0:1790772274.885148:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:2.0:1790772274.885157:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+6:13719:x1877760412851584:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790772274.885174:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772274.885191:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9abe00/0xdf68d9a7d6a91224 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226d99 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772274.885218:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9abe00/0xdf68d9a7d6a91224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d99 expref: 7 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772274.885230:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9abe00/0xdf68d9a7d6a91224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226d99 expref: 7 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772274.885239:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9abe00, rc 0) 00000100:00100000:2.0:1790772274.885294:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+7:13719:x1877760412851584:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 138us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772274.885313:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:0.0:1790772274.894929:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772274.896088:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412851712 00000100:00100000:2.0:1790772274.896100:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412851712 00000100:00100000:2.0:1790772274.896162:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:2.0:1790772274.896171:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+7:13719:x1877760412851712:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790772274.896968:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+8:13719:x1877760412851712:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 794us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772274.896978:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:3.0:1790772274.898750:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772274.899400:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412851840 00000100:00100000:1.0:1790772274.899414:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412851840 00000100:00100000:1.0:1790772274.899482:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:1.0:1790772274.899492:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+8:13719:x1877760412851840:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790772274.900094:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+8:13719:x1877760412851840:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 600us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772274.900103:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:3.0:1790772274.904248:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772274.905024:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412851968 00000100:00100000:1.0:1790772274.905039:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412851968 00000100:00100000:1.0:1790772274.905132:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:1.0:1790772274.905143:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+8:13737:x1877760412851968:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790772274.906217:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+8:13737:x1877760412851968:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 1067us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772274.906230:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:3.0:1790772274.958680:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772274.959657:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412852096 00000100:00100000:0.0:1790772274.959674:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412852096 00000100:00100000:0.0:1790772274.959748:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 81 00000100:00100000:0.0:1790772274.959758:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+8:13737:x1877760412852096:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772274.960033:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+8:13737:x1877760412852096:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 276us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772274.960052:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 81 00000100:00100000:2.0:1790772274.963886:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772274.965092:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412852224 00000100:00100000:1.0:1790772274.965122:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412852224 00000100:00100000:1.0:1790772274.965219:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:1.0:1790772274.965231:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+8:13719:x1877760412852224:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790772274.965254:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772274.965279:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a9122b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226dc3 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772274.965317:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a9122b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dc3 expref: 9 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772274.965354:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b8e00/0xdf68d9a7d6a9122b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dc3 expref: 9 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772274.965364:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8e00, rc 0) 00000100:00100000:1.0:1790772274.965934:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+9:13719:x1877760412852224:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 701us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772274.965943:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:1.0:1790772274.982288:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772274.982596:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412852352 00000100:00100000:3.0:1790772274.982606:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412852352 00000100:00100000:3.0:1790772274.982648:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 83 00000100:00100000:3.0:1790772274.982657:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+9:13719:x1877760412852352:12345-192.168.206.27@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790772274.982682:0:14341:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790772274.982708:0:14341:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790772274.982712:0:14341:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790772274.982715:0:14341:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790772274.982718:0:14341:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1790772274.985708:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+9:13719:x1877760412852352:12345-192.168.206.27@tcp:256:mount.lustre.0 Request processed in 3042us (3426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772274.985722:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 83 00000100:00100000:2.0:1790772274.989653:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772274.990618:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412852480 00000100:00100000:1.0:1790772274.990631:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412852480 00000100:00100000:1.0:1790772274.990732:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:1.0:1790772274.990742:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+9:13719:x1877760412852480:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790772274.990757:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772274.990774:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a91232 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226dca expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772274.990801:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a91232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dca expref: 10 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772274.990813:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a91232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dca expref: 10 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772274.990821:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8200, rc 0) 00000100:00100000:1.0:1790772274.990898:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+10:13719:x1877760412852480:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 158us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772274.990905:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:3.0:1790772274.994667:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772275.007506:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412852608 00000100:00100000:0.0:1790772275.007520:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412852608 00000100:00100000:0.0:1790772275.007752:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:0.0:1790772275.007762:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+10:13719:x1877760412852608:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790772275.008108:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+10:13719:x1877760412852608:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 347us (13449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772275.008117:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:3.0:1790772275.019123:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772275.020203:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412852736 00000100:00100000:0.0:1790772275.020218:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412852736 00000100:00100000:0.0:1790772275.020288:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:0.0:1790772275.020298:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+10:13719:x1877760412852736:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790772275.020724:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+10:13719:x1877760412852736:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 426us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772275.020733:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:3.0:1790772275.029219:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772275.029457:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412852864 00000100:00100000:2.0:1790772275.029469:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412852864 00000100:00100000:2.0:1790772275.029604:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 87 00000100:00100000:2.0:1790772275.029615:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+10:13742:x1877760412852864:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772275.030063:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+10:13742:x1877760412852864:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 447us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772275.030073:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 87 00000100:00100000:3.0:1790772275.042460:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772275.042612:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412852992 00000100:00100000:1.0:1790772275.042626:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412852992 00000100:00100000:1.0:1790772275.042695:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 88 00000100:00100000:1.0:1790772275.042708:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+10:13742:x1877760412852992:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790772275.042967:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+10:13742:x1877760412852992:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 263us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772275.042976:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 88 00000100:00100000:3.0:1790772275.049640:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772275.049743:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412853120 00000100:00100000:1.0:1790772275.049758:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412853120 00000100:00100000:1.0:1790772275.049824:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1790772275.049831:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2346:x1877760412853120:12345-192.168.206.27@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790772275.049859:0:14348:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d@192.168.206.27@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1790772275.049903:0:14348:0:(genops.c:1384:class_connect()) connect: client 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d, cookie 0xdf68d9a7d6a91239 00000004:00100000:1.0:1790772275.049933:0:14348:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1790772275.049938:0:14348:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1790772275.135857:0:14348:0:(import.c:65:import_set_state_nolock()) ffff8df27c0f6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772275.135943:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2346:x1877760412853120:12345-192.168.206.27@tcp:38:mount.lustre.0 Request processed in 86110us (86314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772275.135954:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:3.0:1790772275.147221:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772275.147380:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412853376 00000100:00100000:1.0:1790772275.147396:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412853376 00000100:00100000:1.0:1790772275.147495:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:1.0:1790772275.147507:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13719:x1877760412853376:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790772275.147602:0:14347:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790772275.147722:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13719:x1877760412853376:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 217us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772275.147754:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00080000:2.0:1790772275.148203:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772275.152028:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772275.152253:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412853248 00000100:00100000:3.0:1790772275.152609:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412853248 00000100:00100000:3.0:1790772275.152694:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:3.0:1790772275.152706:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:0:x1877760412853248:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790772275.152748:0:14348:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790772275.152864:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:0:x1877760412853248:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 160us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772275.152872:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:0.0:1790772275.153031:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772275.153912:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412853504 00000100:00100000:3.0:1790772275.153921:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412853504 00000100:00100000:3.0:1790772275.153975:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:3.0:1790772275.153984:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13719:x1877760412853504:12345-192.168.206.27@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790772275.154080:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13719:x1877760412853504:12345-192.168.206.27@tcp:40:mount.lustre.0 Request processed in 97us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772275.154088:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1790772275.168263:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772275.168297:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428574464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772275.168388:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772275.168472:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428574464 00000100:00100000:0.0:1790772275.168481:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428574464 00000100:00100000:0.0:1790772275.168536:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772275.168579:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428574464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790772275.168627:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772275.168704:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428574464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772275.168712:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772275.168782:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428574464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772275.168863:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772275.168900:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772275.168923:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412853632 00000100:00100000:0.0:1790772275.168927:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412853632 00000100:00100000:0.0:1790772275.168948:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412853760 00000100:00100000:0.0:1790772275.168951:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412853760 00000100:00100000:0.0:1790772275.168963:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:0.0:1790772275.168968:0:15032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1877760412853632:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790772275.168995:0:15032:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d@192.168.206.27@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:0.0:1790772275.169047:0:15032:0:(genops.c:1384:class_connect()) connect: client 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d, cookie 0xdf68d9a7d6a91240 00002000:00100000:0.0:1790772275.169063:0:15032:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d/ffff8df248b55000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790772275.169076:0:15032:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790772275.170300:0:15032:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790772275.170344:0:15032:0:(import.c:65:import_set_state_nolock()) ffff8df248b50800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772275.170495:0:15032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2346:x1877760412853632:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 1524us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772275.170505:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:0.0:1790772275.170537:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:0.0:1790772275.170545:0:15032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1877760412853760:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790772275.176410:0:15032:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d@192.168.206.27@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:0.0:1790772275.176456:0:15032:0:(genops.c:1384:class_connect()) connect: client 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d, cookie 0xdf68d9a7d6a91247 00002000:00100000:0.0:1790772275.176474:0:15032:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d/ffff8df248b57000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790772275.176488:0:15032:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790772275.176938:0:15032:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790772275.176981:0:15032:0:(import.c:65:import_set_state_nolock()) ffff8df248b53000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790772275.183426:0:15032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2346:x1877760412853760:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 12861us (14505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772275.183445:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:1.0:1790772275.183672:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772275.183921:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412853888 00000100:00100000:0.0:1790772275.183932:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412853888 00000100:00100000:0.0:1790772275.184068:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:0.0:1790772275.184080:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13719:x1877760412853888:12345-192.168.206.27@tcp:33:mount.lustre.0 00000004:00080000:1.0:1790772275.188121:0:14349:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3959us 00000004:00200000:0.0:1790772275.210200:0:14349:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790772275.210394:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13719:x1877760412853888:12345-192.168.206.27@tcp:33:mount.lustre.0 Request processed in 26308us (26714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772275.210407:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:2.0:1790772275.406423:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772275.406535:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412854016 00000100:00100000:3.0:1790772275.406588:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412854016 00000100:00100000:3.0:1790772275.406664:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:3.0:1790772275.406677:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13763:x1877760412854016:12345-192.168.206.27@tcp:101:mkdir.0 00010000:00010000:3.0:1790772275.406703:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772275.406736:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9124e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226df4 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772275.406822:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f200/0xdf68d9a7d6a91255 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772275.406840:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f200/0xdf68d9a7d6a91255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772275.406856:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f200/0xdf68d9a7d6a91255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772275.406902:0:14346:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772275.406923:0:14346:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772275.406969:0:14346:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f200/0xdf68d9a7d6a91255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772275.407012:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9124e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226df4 expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772275.407035:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f200/0xdf68d9a7d6a91255 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226df4 expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772275.407054:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07300) 00010000:00010000:3.0:1790772275.407057:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772275.407061:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df142c8f200, rc 0) 00000100:00100000:3.0:1790772275.407155:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:13763:x1877760412854016:12345-192.168.206.27@tcp:101:mkdir.0 Request processed in 481us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772275.407164:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00010000:00010000:2.0:1790772275.489402:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772276.195225:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790772276.511756:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772277.431925:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772277.432376:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412854144 00000100:00100000:3.0:1790772277.432386:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412854144 00000100:00100000:3.0:1790772277.438277:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:3.0:1790772277.438293:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:13816:x1877760412854144:12345-192.168.206.27@tcp:41:lfs.0 00000004:00000024:3.0:1790772277.438336:0:14348:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790772277.438438:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:13816:x1877760412854144:12345-192.168.206.27@tcp:41:lfs.0 Request processed in 150us (6521us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772277.439013:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00080000:2.0:1790772277.444399:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772277.444881:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772277.445046:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412854272 00000100:00100000:0.0:1790772277.445068:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412854272 00000100:00100000:0.0:1790772277.445151:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:0.0:1790772277.445161:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13816:x1877760412854272:12345-192.168.206.27@tcp:13:lfs.0 00002000:00000024:0.0:1790772277.445196:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772277.445281:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13816:x1877760412854272:12345-192.168.206.27@tcp:13:lfs.0 Request processed in 121us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772277.445289:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00080000:2.0:1790772277.445586:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772277.454841:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772277.454927:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412854400 00000100:00100000:0.0:1790772277.454937:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412854400 00000100:00100000:0.0:1790772277.454999:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1790772277.455008:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13816:x1877760412854400:12345-192.168.206.27@tcp:13:lfs.0 00002000:00000024:0.0:1790772277.455052:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772277.455137:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:13816:x1877760412854400:12345-192.168.206.27@tcp:13:lfs.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772277.455145:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00080000:2.0:1790772277.455528:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790772277.535720:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772277.741256:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772277.741417:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412854528 00000100:00100000:2.0:1790772277.741446:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412854528 00000100:00100000:2.0:1790772277.741517:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:2.0:1790772277.741527:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+10:13849:x1877760412854528:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790772277.741585:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772277.741608:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9aa200/0xdf68d9a7d6a9125c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226dfb expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772277.741644:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9aa200/0xdf68d9a7d6a9125c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dfb expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772277.741658:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9aa200/0xdf68d9a7d6a9125c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dfb expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772277.741669:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa200, rc 0) 00000100:00100000:2.0:1790772277.741742:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13849:x1877760412854528:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 217us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772277.741750:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:1.0:1790772277.746850:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772277.747096:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412854656 00000100:00100000:2.0:1790772277.747111:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412854656 00000100:00100000:2.0:1790772277.747186:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:2.0:1790772277.747198:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13849:x1877760412854656:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790772277.747636:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13849:x1877760412854656:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 438us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772277.747646:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:1.0:1790772277.758667:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772277.758760:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412854784 00000100:00100000:2.0:1790772277.758775:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412854784 00000100:00100000:2.0:1790772277.758849:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 91 00000100:00100000:2.0:1790772277.758861:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13849:x1877760412854784:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790772277.759223:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13849:x1877760412854784:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 364us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772277.759233:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 91 00000100:00100000:1.0:1790772277.774845:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772277.775233:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412854912 00000100:00100000:0.0:1790772277.775247:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412854912 00000100:00100000:0.0:1790772277.775320:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 92 00000100:00100000:0.0:1790772277.775331:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13855:x1877760412854912:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772277.775708:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13855:x1877760412854912:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 378us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772277.775717:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 92 00000100:00100000:3.0:1790772277.798457:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772277.798635:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412855040 00000100:00100000:1.0:1790772277.798650:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412855040 00000100:00100000:1.0:1790772277.798723:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:1.0:1790772277.798735:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13855:x1877760412855040:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790772277.799106:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13855:x1877760412855040:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 371us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772277.799116:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:1.0:1790772277.815628:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772277.816055:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412855168 00000100:00100000:2.0:1790772277.816068:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412855168 00000100:00100000:2.0:1790772277.816138:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:2.0:1790772277.816149:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13849:x1877760412855168:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790772277.816170:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772277.816200:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9ab800/0xdf68d9a7d6a91263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e25 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772277.816236:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9ab800/0xdf68d9a7d6a91263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e25 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772277.816249:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9ab800/0xdf68d9a7d6a91263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e25 expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772277.816260:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab800, rc 0) 00000100:00100000:2.0:1790772277.816337:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:13849:x1877760412855168:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 189us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772277.816345:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:2.0:1790772277.822869:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772277.823529:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412855296 00000100:00100000:0.0:1790772277.823545:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412855296 00000100:00100000:0.0:1790772277.823672:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 95 00000100:00100000:0.0:1790772277.823684:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:13849:x1877760412855296:12345-192.168.206.27@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790772277.823740:0:14340:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790772277.823761:0:14340:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790772277.823766:0:14340:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790772277.823769:0:14340:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790772277.823772:0:14340:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790772277.825817:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:13849:x1877760412855296:12345-192.168.206.27@tcp:256:mount.lustre.0 Request processed in 2121us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772277.825835:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 95 00000100:00100000:1.0:1790772277.829318:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772277.829737:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412855424 00000100:00100000:2.0:1790772277.829751:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412855424 00000100:00100000:2.0:1790772277.829832:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 96 00000100:00100000:2.0:1790772277.829843:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:13849:x1877760412855424:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790772277.829869:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772277.829913:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9ab200/0xdf68d9a7d6a9126a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e2c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772277.829961:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9ab200/0xdf68d9a7d6a9126a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e2c expref: 13 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772277.829975:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9ab200/0xdf68d9a7d6a9126a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e2c expref: 13 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772277.829986:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9ab200, rc 0) 00000100:00100000:2.0:1790772277.830072:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13849:x1877760412855424:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 230us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772277.830080:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 96 00000100:00100000:2.0:1790772277.832335:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772277.832454:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412855552 00000100:00100000:0.0:1790772277.832466:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412855552 00000100:00100000:0.0:1790772277.832621:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 97 00000100:00100000:0.0:1790772277.832635:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13849:x1877760412855552:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790772277.833046:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13849:x1877760412855552:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 412us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772277.833056:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 97 00000100:00100000:3.0:1790772277.835715:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772277.835851:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412855680 00000100:00100000:2.0:1790772277.835864:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412855680 00000100:00100000:2.0:1790772277.835988:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 98 00000100:00100000:2.0:1790772277.836000:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13849:x1877760412855680:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790772277.836320:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13849:x1877760412855680:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 322us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772277.836330:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 98 00000100:00100000:2.0:1790772277.839681:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772277.840233:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412855808 00000100:00100000:0.0:1790772277.840246:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412855808 00000100:00100000:0.0:1790772277.840375:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:0.0:1790772277.840387:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13858:x1877760412855808:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790772277.840735:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13858:x1877760412855808:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 350us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772277.840745:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:3.0:1790772277.849316:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772277.849592:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412855936 00000100:00100000:2.0:1790772277.849606:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412855936 00000100:00100000:2.0:1790772277.849672:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 100 00000100:00100000:2.0:1790772277.849683:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13858:x1877760412855936:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790772277.849988:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13858:x1877760412855936:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 306us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772277.850003:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 100 00000100:00100000:3.0:1790772277.861768:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772277.861809:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772277.861837:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772277.861878:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772277.861898:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772277.862216:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412856832 00000100:00100000:2.0:1790772277.862229:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412856832 00000100:00100000:2.0:1790772277.862291:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412856704 00000100:00100000:2.0:1790772277.862293:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412856704 00000100:00100000:2.0:1790772277.862321:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:2.0:1790772277.862331:0:15032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2347:x1877760412856832:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772277.862418:0:15032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2347:x1877760412856832:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 89us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772277.862426:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:2.0:1790772277.862443:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1790772277.862448:0:15032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2347:x1877760412856704:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772277.862468:0:15032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2347:x1877760412856704:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 20us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772277.862473:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:1.0:1790772277.863308:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412856064 00000100:00100000:1.0:1790772277.863319:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412856064 00000100:00100000:1.0:1790772277.863363:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412856576 00000100:00100000:1.0:1790772277.863367:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412856576 00000100:00100000:1.0:1790772277.863397:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:1.0:1790772277.863406:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:2347:x1877760412856576:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772277.863488:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:2347:x1877760412856576:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 82us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772277.863516:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:1.0:1790772277.863534:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:1.0:1790772277.863538:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2346:x1877760412856064:12345-192.168.206.27@tcp:38:mount.lustre.0 00000100:00100000:0.0:1790772277.863663:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412856448 00000100:00100000:0.0:1790772277.863668:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412856448 00000100:00100000:0.0:1790772277.863701:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 101 00000100:00100000:0.0:1790772277.863709:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:2347:x1877760412856448:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772277.863746:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:2347:x1877760412856448:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 38us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772277.863753:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 101 00010000:00080000:1.0:1790772277.865836:0:14347:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from eb341af7-d0c4-44fd-ace0-14263cdbead7@192.168.206.27@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:1.0:1790772277.865896:0:14347:0:(genops.c:1384:class_connect()) connect: client eb341af7-d0c4-44fd-ace0-14263cdbead7, cookie 0xdf68d9a7d6a91271 00000004:00100000:1.0:1790772277.865939:0:14347:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790772277.866276:0:14347:0:(import.c:65:import_set_state_nolock()) ffff8df27af1c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790772277.866385:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:2346:x1877760412856064:12345-192.168.206.27@tcp:38:mount.lustre.0 Request processed in 2842us (4627us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772277.866397:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:3.0:1790772277.872673:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772277.872726:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412856320 00000100:00100000:0.0:1790772277.872739:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412856320 00000100:00100000:0.0:1790772277.872844:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1790772277.872855:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:13849:x1877760412856320:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790772277.872912:0:14346:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790772277.873019:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:13849:x1877760412856320:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 165us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772277.873037:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1790772277.873144:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772277.873331:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412856192 00000100:00100000:3.0:1790772277.873336:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412856192 00000100:00100000:3.0:1790772277.873374:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:3.0:1790772277.873382:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:0:x1877760412856192:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790772277.873397:0:14347:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790772277.873434:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:0:x1877760412856192:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 53us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772277.873440:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:0.0:1790772277.874917:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772277.875002:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412856960 00000100:00100000:3.0:1790772277.875012:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412856960 00000100:00080000:1.0:1790772277.875058:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772277.875080:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:3.0:1790772277.875097:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:13849:x1877760412856960:12345-192.168.206.27@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790772277.875193:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:13849:x1877760412856960:12345-192.168.206.27@tcp:40:mount.lustre.0 Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772277.875201:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:2.0:1790772277.877054:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772277.877219:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412857344 00000100:00100000:3.0:1790772277.877230:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412857344 00000100:00100000:3.0:1790772277.877284:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:3.0:1790772277.877293:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:13849:x1877760412857344:12345-192.168.206.27@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790772277.877399:0:14350:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790772277.877510:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:13849:x1877760412857344:12345-192.168.206.27@tcp:33:mount.lustre.0 Request processed in 218us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772277.877517:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:2.0:1790772277.881893:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772277.882014:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772277.882332:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412857088 00000100:00100000:0.0:1790772277.882345:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412857088 00000100:00100000:0.0:1790772277.882456:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412857216 00000100:00100000:0.0:1790772277.882461:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412857216 00000100:00100000:3.0:1790772277.882498:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:3.0:1790772277.882510:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1877760412857088:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790772277.882578:0:15031:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from eb341af7-d0c4-44fd-ace0-14263cdbead7@192.168.206.27@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:3.0:1790772277.882619:0:15031:0:(genops.c:1384:class_connect()) connect: client eb341af7-d0c4-44fd-ace0-14263cdbead7, cookie 0xdf68d9a7d6a91278 00002000:00100000:3.0:1790772277.882635:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eb341af7-d0c4-44fd-ace0-14263cdbead7/ffff8df245332000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790772277.882649:0:15031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790772277.882789:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790772277.882826:0:15031:0:(import.c:65:import_set_state_nolock()) ffff8df245331800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772277.882915:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:2346:x1877760412857088:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 405us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772277.882922:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:3.0:1790772277.882945:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:3.0:1790772277.882950:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1877760412857216:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790772277.882967:0:15031:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from eb341af7-d0c4-44fd-ace0-14263cdbead7@192.168.206.27@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:3.0:1790772277.882989:0:15031:0:(genops.c:1384:class_connect()) connect: client eb341af7-d0c4-44fd-ace0-14263cdbead7, cookie 0xdf68d9a7d6a9127f 00002000:00100000:3.0:1790772277.882994:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eb341af7-d0c4-44fd-ace0-14263cdbead7/ffff8df259057800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790772277.883001:0:15031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790772277.883071:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790772277.883099:0:15031:0:(import.c:65:import_set_state_nolock()) ffff8df27c046800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772277.883123:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:2346:x1877760412857216:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 172us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772277.883150:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:2.0:1790772278.096280:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772278.096516:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412857472 00000100:00100000:0.0:1790772278.096530:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412857472 00000100:00100000:0.0:1790772278.096616:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1790772278.096627:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:13879:x1877760412857472:12345-192.168.206.27@tcp:101:mkdir.0 00010000:00010000:0.0:1790772278.096651:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772278.096679:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a91286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e56 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772278.096756:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772278.096793:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772278.096809:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772278.096853:0:14348:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790772278.096858:0:14348:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772278.096883:0:14348:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772278.096912:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a91286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e56 expref: 8 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772278.096934:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e56 expref: 7 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772278.096942:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07300) 00010000:00010000:0.0:1790772278.096945:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790772278.096949:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030200, rc 0) 00000100:00100000:0.0:1790772278.097257:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb341af7-d0c4-44fd-ace0-14263cdbead7+7:13879:x1877760412857472:12345-192.168.206.27@tcp:101:mkdir.0 Request processed in 631us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772278.097266:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00010000:00010000:2.0:1790772278.560647:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772279.584240:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772279.778274:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772279.778299:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428574592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772279.778373:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772279.778460:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f131dbd3-adf7-4830-81da-ffe0e188139b:3294:1877760428574720:0@lo:400:kworker.0 00000100:00100000:0.0:1790772279.778479:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428574848:0@lo:400:kworker.0 00000100:00100000:3.0:1790772279.778521:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772279.778595:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772279.778627:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1877760428575232:0@lo:400:kworker.0 00000100:00100000:0.0:1790772279.778646:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790772279.778659:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428574976:0@lo:400:kworker.0 00000100:00100000:3.0:1790772279.778675:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772279.778727:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772279.778731:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772279.778746:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428575104:0@lo:400:kworker.0 00000100:00100000:3.0:1790772279.778788:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772279.778789:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428574848 00000100:00100000:0.0:1790772279.778802:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428574848 00000100:00100000:3.0:1790772279.778845:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428574592 00000100:00100000:3.0:1790772279.778854:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428574592 00000100:00100000:0.0:1790772279.778883:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772279.778897:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428574848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772279.778917:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790772279.778931:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428574592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772279.778971:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790772279.778974:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428574848:12345-0@lo:400:kworker.0 Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772279.778985:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1790772279.779027:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772279.779033:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772279.779071:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428574848:0@lo:400:kworker.0 00000100:00100000:3.0:1790772279.779199:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428574592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 270us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772279.779206:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790772279.779233:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428574720 00000100:00100000:3.0:1790772279.779237:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428574720 00000100:00100000:3.0:1790772279.779263:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790772279.779270:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3294:x1877760428574720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772279.779301:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3294:x1877760428574720:12345-0@lo:400:kworker.0 Request processed in 32us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772279.779318:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790772279.779346:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428575232 00000100:00100000:3.0:1790772279.779350:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428575232 00000100:00100000:3.0:1790772279.779388:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428574976 00000100:00100000:0.0:1790772279.779389:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f131dbd3-adf7-4830-81da-ffe0e188139b:3294:1877760428574720:0@lo:400:kworker.0 00000100:00100000:3.0:1790772279.779396:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428574976 00000100:00100000:0.0:1790772279.779412:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790772279.779419:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428575104 00000100:00100000:3.0:1790772279.779425:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428575104 00000100:00100000:0.0:1790772279.779443:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428574592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772279.779456:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772279.779467:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877760428575232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772279.779518:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877760428575232:12345-0@lo:400:kworker.0 Request processed in 54us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772279.779526:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790772279.779577:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772279.779592:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428574976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772279.779593:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1877760428575232:0@lo:400:kworker.0 00000100:00100000:3.0:1790772279.779660:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877760428574976:12345-0@lo:400:kworker.0 Request processed in 72us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772279.779670:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772279.779692:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772279.779701:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428575104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772279.779747:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877760428575104:12345-0@lo:400:kworker.0 Request processed in 49us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772279.779755:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1790772279.779805:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772279.779843:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1877760428575104:0@lo:400:kworker.0 00000100:00100000:0.0:1790772279.780183:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877760428574976:0@lo:400:kworker.0 00000001:00100000:1.0:1790772279.842058:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d 00000001:00100000:1.0:1790772279.842085:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eb341af7-d0c4-44fd-ace0-14263cdbead7 00000100:00100000:2.0:1790772280.287866:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27401dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428575360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772280.287969:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772280.288132:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428575360 00000100:00100000:2.0:1790772280.288142:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428575360 00000100:00100000:2.0:1790772280.288225:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772280.288235:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428575360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772280.288280:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772280.288348:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428575360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772280.288356:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790772280.288418:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27401dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428575360:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1790772280.373129:0:5845:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eb341af7-d0c4-44fd-ace0-14263cdbead7 00000001:00100000:2.0:1790772280.373149:0:5845:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d 00000001:00100000:3.0:1790772280.402064:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 77ee458b-e89d-44eb-8d29-5e9e1ecfc28d 00000001:00100000:0.0:1790772280.402331:0:6704:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb341af7-d0c4-44fd-ace0-14263cdbead7 00010000:00010000:2.0:1790772280.607778:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790772281.290835:0:16311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790772281.641983:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772282.656051:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772282.927107:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772282.927153:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772282.927174:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772282.927211:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772282.927231:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772282.927249:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772282.927283:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772282.927313:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412857984 00000100:00100000:2.0:1790772282.927324:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412857984 00000100:00100000:2.0:1790772282.927383:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412858240 00000100:00100000:2.0:1790772282.927386:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412858240 00000100:00100000:2.0:1790772282.927401:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412857856 00000100:00100000:2.0:1790772282.927403:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412857856 00000100:00100000:2.0:1790772282.927413:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412858368 00000100:00100000:2.0:1790772282.927416:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412858368 00000100:00100000:2.0:1790772282.927433:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:2.0:1790772282.927443:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412857984:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772282.927589:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412857984:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 107us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772282.927598:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:2.0:1790772282.927616:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:2.0:1790772282.927623:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412858240:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772282.927650:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412858240:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772282.927657:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:2.0:1790772282.927668:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:2.0:1790772282.927674:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412857856:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772282.927696:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412857856:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 22us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772282.927702:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:2.0:1790772282.927712:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:2.0:1790772282.927718:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412858368:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772282.927748:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412858368:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 30us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772282.927755:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:2.0:1790772282.927774:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412857600 00000100:00100000:2.0:1790772282.927778:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412857600 00000100:00100000:2.0:1790772282.927801:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 103 00000100:00100000:2.0:1790772282.927808:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:2347:x1877760412857600:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772282.927832:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:2347:x1877760412857600:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 24us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772282.927845:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 103 00000100:00100000:3.0:1790772282.928151:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412857728 00000100:00100000:3.0:1790772282.928162:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412857728 00000100:00100000:3.0:1790772282.928204:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412858112 00000100:00100000:3.0:1790772282.928208:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412858112 00000100:00100000:3.0:1790772282.928224:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:3.0:1790772282.928231:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2347:x1877760412857728:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772282.928273:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2347:x1877760412857728:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 42us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772282.928280:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:3.0:1790772282.928293:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:3.0:1790772282.928300:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:2347:x1877760412858112:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772282.928326:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:2347:x1877760412858112:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 27us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772282.928333:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00080000:3.0:1790772282.928358:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772282.928363:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790772282.928366:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790772283.685690:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772284.706713:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772284.895803:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428575616:0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.895871:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772284.895917:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428576128:0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.895941:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772284.895965:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772284.895985:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428575744:0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.896024:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772284.896070:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428575616 00000100:00100000:0.0:1790772284.896081:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428575616 00000100:00100000:0.0:1790772284.896139:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428575744 00000100:00100000:0.0:1790772284.896143:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428575744 00000100:00100000:0.0:1790772284.896162:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790772284.896170:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428575616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.896219:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428575616:12345-0@lo:400:kworker.0 Request processed in 50us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772284.896226:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790772284.896242:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772284.896249:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428575744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.896289:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428575744:12345-0@lo:400:kworker.0 Request processed in 41us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772284.896295:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772284.896313:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428576128 00000100:00100000:0.0:1790772284.896316:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428576128 00000100:00100000:0.0:1790772284.896341:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790772284.896348:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428576128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.896377:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877760428576128:12345-0@lo:400:kworker.0 Request processed in 29us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772284.896383:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1790772284.896401:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790772284.896405:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790772284.896407:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772284.896438:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428575744:0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.896461:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428575616:0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.896469:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1877760428576128:0@lo:400:kworker.0 00000100:00100000:1.0:1790772284.896797:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f131dbd3-adf7-4830-81da-ffe0e188139b:3296:1877760428575488:0@lo:400:kworker.0 00000100:00100000:1.0:1790772284.896835:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772284.896862:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428576000:0@lo:400:kworker.0 00000100:00100000:1.0:1790772284.896885:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772284.896906:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790772284.896912:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428575872:0@lo:400:kworker.0 00000100:00100000:1.0:1790772284.896932:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772284.896955:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428576000 00000100:00100000:1.0:1790772284.896959:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428576000 00000100:00100000:1.0:1790772284.897002:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428575872 00000100:00100000:1.0:1790772284.897012:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428575872 00000100:00100000:1.0:1790772284.897032:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790772284.897039:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428576000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772284.897076:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1877760428576000:12345-0@lo:400:kworker.0 Request processed in 38us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772284.897083:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790772284.897096:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790772284.897102:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428575872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772284.897191:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1877760428575872:12345-0@lo:400:kworker.0 Request processed in 89us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772284.897198:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1790772284.897217:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772284.897493:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1877760428575872:0@lo:400:kworker.0 00000100:00100000:1.0:1790772284.897503:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1877760428576000:0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.900445:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428575488 00000100:00100000:0.0:1790772284.900461:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428575488 00000100:00100000:0.0:1790772284.900523:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790772284.900533:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3296:x1877760428575488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.900643:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3296:x1877760428575488:12345-0@lo:400:kworker.0 Request processed in 112us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772284.900651:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790772284.904393:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f131dbd3-adf7-4830-81da-ffe0e188139b:3296:1877760428575488:0@lo:400:kworker.0 00000100:00100000:0.0:1790772284.906096:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428576256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772284.906176:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772284.909400:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428576256 00000100:00100000:3.0:1790772284.909414:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428576256 00000100:00100000:3.0:1790772284.909464:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772284.909474:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428576256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772284.909510:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772284.909606:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428576256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (3429us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772284.909613:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790772284.909843:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428576256:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1790772285.127084:0:16460:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea5798a40 20000000:00000080:2.0:1790772285.127104:0:16460:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df143a0cc00 uarg=0000000000000000 20000000:01000000:2.0:1790772285.127262:0:16460:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790772285.127268:0:16460:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790772285.127272:0:16460:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790772285.131021:0:16461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1790772285.132530:0:16460:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790772285.143543:0:16460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790772285.143620:0:16460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.143644:0:16460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241327200/0xdf68d9a7d6a90f8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90f84 expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.143653:0:16460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241326e00/0xdf68d9a7d6a90fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a90fd1 expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.143660:0:16460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f9b9a00/0xdf68d9a7d6a91113 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a9110c expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.143671:0:16460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a91232 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dca expref: 12 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.143679:0:16460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df26f9ab200/0xdf68d9a7d6a9126a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e2c expref: 12 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.143687:0:16460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.143742:0:16460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f9ab200/0xdf68d9a7d6a9126a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e2c expref: 12 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.143761:0:16460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df26f9ab200/0xdf68d9a7d6a9126a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e2c expref: 12 pid: 14342 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772285.143779:0:16460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f9c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16460:1877760428576384:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772285.145433:0:16460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a91232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dca expref: 12 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.145479:0:16460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a91232 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dca expref: 12 pid: 14342 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772285.145496:0:16460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16460:1877760428576512:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772285.145616:0:16460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df26f9b9a00/0xdf68d9a7d6a91113 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a9110c expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.145625:0:16460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df26f9b9a00/0xdf68d9a7d6a91113 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a9110c expref: 18 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772285.145635:0:16460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16460:1877760428576640:0@lo:104: 00000100:00100000:3.0:1790772285.145686:0:16460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772285.145737:0:16460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241326e00/0xdf68d9a7d6a90fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a90fd1 expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.145745:0:16460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df241326e00/0xdf68d9a7d6a90fd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90fd1 expref: 18 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772285.145755:0:16460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16460:1877760428576768:0@lo:104: 00000100:00100000:3.0:1790772285.145776:0:16460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790772285.145799:0:16460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241327200/0xdf68d9a7d6a90f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf68d9a7d6a90f84 expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.145808:0:16460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df241327200/0xdf68d9a7d6a90f8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f84 expref: 18 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772285.145816:0:16460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16460:1877760428576896:0@lo:104: 00000100:00100000:3.0:1790772285.145845:0:16460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772285.145867:0:16460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df252011c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772285.145896:0:14331:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790772285.145923:0:14331:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428576640 00000100:00100000:0.0:1790772285.145932:0:14331:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428576640 00000100:00100000:0.0:1790772285.146635:0:14331:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428576768 00000100:00100000:0.0:1790772285.146654:0:14331:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428576768 00000100:00100000:0.0:1790772285.146785:0:14331:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428576896 00000100:00100000:0.0:1790772285.146790:0:14331:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428576896 00000100:00100000:0.0:1790772285.146812:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772285.146821:0:14331:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+5:16460:x1877760428576640:12345-0@lo:104: 00010000:00010000:0.0:1790772285.146838:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.146932:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790772285.146939:0:14331:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+5:16460:x1877760428576640:12345-0@lo:104: Request processed in 119us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772285.147249:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772285.147269:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772285.147275:0:14331:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+4:16460:x1877760428576768:12345-0@lo:104: 00010000:00010000:0.0:1790772285.147284:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.147324:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790772285.147329:0:14331:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+4:16460:x1877760428576768:12345-0@lo:104: Request processed in 55us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772285.147335:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790772285.147348:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772285.147353:0:14331:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c03b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+3:16460:x1877760428576896:12345-0@lo:104: 00010000:00010000:0.0:1790772285.148803:0:14331:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.148901:0:14331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790772285.148911:0:14331:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c03b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f131dbd3-adf7-4830-81da-ffe0e188139b+3:16460:x1877760428576896:12345-0@lo:104: Request processed in 1554us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772285.148920:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1790772285.149259:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790772285.149267:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149274:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772285.149278:0:14336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149287:0:14336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772285.149294:0:14336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772285.149316:0:14336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790772285.149355:0:14336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149362:0:14336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772285.149380:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149387:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a9110c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a91113 expref: -99 pid: 15752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149401:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790772285.149404:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149409:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772285.149412:0:14336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149419:0:14336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772285.149425:0:14336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772285.149430:0:14336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790772285.149441:0:14336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149446:0:14336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772285.149456:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149463:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df26f9b9200/0xdf68d9a7d6a90fd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90fd8 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149472:0:14336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790772285.149475:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149480:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1790772285.149483:0:14336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149489:0:14336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790772285.149495:0:14336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772285.149499:0:14336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790772285.149796:0:14336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149803:0:14336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790772285.149820:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149827:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff8df240031a00/0xdf68d9a7d6a90f84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf68d9a7d6a90f8b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772285.149853:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772285.149855:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772285.149858:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772285.149889:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f131dbd3-adf7-4830-81da-ffe0e188139b:3295:1877760428577024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772285.150026:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772285.150517:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772285.150598:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772285.150649:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790772285.150657:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f131dbd3-adf7-4830-81da-ffe0e188139b:3295:1877760428577152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772285.150844:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772285.150883:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428577280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772285.150916:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772285.151015:0:14334:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428577024 00000100:00100000:2.0:1790772285.151029:0:14334:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428577024 00010000:00010000:2.0:1790772285.151088:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f9b9a00/0xdf68d9a7d6a91113 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a9110c expref: 19 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772285.151116:0:14334:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428577152 00000100:00100000:2.0:1790772285.151119:0:14334:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428577152 00010000:00010000:2.0:1790772285.151132:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241326e00/0xdf68d9a7d6a90fd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90fd1 expref: 20 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772285.151143:0:14334:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428577280 00000100:00100000:2.0:1790772285.151146:0:14334:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428577280 00010000:00010000:2.0:1790772285.151158:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241327200/0xdf68d9a7d6a90f8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f84 expref: 21 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772285.151173:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772285.151182:0:14334:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f131dbd3-adf7-4830-81da-ffe0e188139b+21:3295:x1877760428577024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772285.151199:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772285.151204:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f9b9a00/0xdf68d9a7d6a91113 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a9110c expref: 21 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772285.151227:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f9b9a00/0xdf68d9a7d6a91113 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a9110c expref: 21 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772285.151274:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772285.151312:0:14332:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790772285.151324:0:14332:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1790772285.151354:0:14334:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f131dbd3-adf7-4830-81da-ffe0e188139b+21:3295:x1877760428577024:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772285.151364:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790772285.151390:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772285.151398:0:14334:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f131dbd3-adf7-4830-81da-ffe0e188139b+20:3295:x1877760428577152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772285.151408:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772285.151413:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241326e00/0xdf68d9a7d6a90fd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90fd1 expref: 20 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772285.151424:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241326e00/0xdf68d9a7d6a90fd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90fd1 expref: 20 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772285.151435:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772285.151468:0:14334:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f131dbd3-adf7-4830-81da-ffe0e188139b+20:3295:x1877760428577152:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772285.151476:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790772285.151498:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790772285.151506:0:14334:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2757e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3293:x1877760428577280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790772285.151515:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772285.151520:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241327200/0xdf68d9a7d6a90f8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f84 expref: 19 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772285.151530:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241327200/0xdf68d9a7d6a90f8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f84 expref: 19 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772285.151541:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772285.151611:0:14334:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2757e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3293:x1877760428577280:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772285.151617:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772285.152759:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f131dbd3-adf7-4830-81da-ffe0e188139b:3293:1877760428577280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772285.152826:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f131dbd3-adf7-4830-81da-ffe0e188139b:3295:1877760428577152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790772285.152836:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f131dbd3-adf7-4830-81da-ffe0e188139b:3295:1877760428577024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790772285.158545:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772285.158618:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772285.158662:0:14332:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412858496 00000100:00100000:0.0:1790772285.158689:0:14332:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412858496 00000100:00100000:3.0:1790772285.158707:0:16460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f9c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16460:1877760428576384:192.168.206.27@tcp:104: 00000100:00100000:3.0:1790772285.158725:0:16460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16460:1877760428576512:192.168.206.27@tcp:104: 00010000:00010000:3.0:1790772285.158748:0:16460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b9a00/0xdf68d9a7d6a91113 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a9110c expref: 18 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.158749:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f9ab200/0xdf68d9a7d6a9126a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e2c expref: 13 pid: 14342 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772285.158797:0:16460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16460:1877760428576640:0@lo:104: 00010000:00010000:3.0:1790772285.158817:0:16460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241326e00/0xdf68d9a7d6a90fd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a90fd1 expref: 17 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772285.158818:0:14332:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412858624 00000100:00100000:3.0:1790772285.158831:0:16460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16460:1877760428576768:0@lo:104: 00000100:00100000:0.0:1790772285.158839:0:14332:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412858624 00010000:00010000:3.0:1790772285.158854:0:16460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241327200/0xdf68d9a7d6a90f8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf68d9a7d6a90f84 expref: 16 pid: 14340 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.158863:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a91232 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dca expref: 14 pid: 14342 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772285.158871:0:16460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16460:1877760428576896:0@lo:104: 00000100:00100000:0.0:1790772285.158906:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1790772285.158918:0:14332:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+14:2347:x1877760412858496:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772285.158931:0:16460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.158934:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772285.158947:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f9ab200/0xdf68d9a7d6a9126a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e2c expref: 14 pid: 14342 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.158974:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f9ab200/0xdf68d9a7d6a9126a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e2c expref: 14 pid: 14342 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159000:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9ab200/0xdf68d9a7d6a9126a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e2c expref: 14 pid: 14342 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159016:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772285.159083:0:14332:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:2347:x1877760412858496:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 167us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772285.159090:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1790772285.159119:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:0.0:1790772285.159125:0:14332:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:2348:x1877760412858624:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772285.159132:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772285.159137:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a91232 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dca expref: 12 pid: 14342 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159146:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a91232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dca expref: 12 pid: 14342 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159167:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df26f9b8200/0xdf68d9a7d6a91232 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226dca expref: 12 pid: 14342 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159177:0:14332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159186:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159202:0:14332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159209:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159216:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159224:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159230:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8ee00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:0.0:1790772285.159234:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159241:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159255:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772285.159274:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772285.159303:0:14332:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:2348:x1877760412858624:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 167us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772285.159310:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00010000:00010000:3.0:1790772285.160544:0:16460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.160586:0:16460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772285.160595:0:16460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df142c8ee00/0xdf68d9a7d6a91294 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772285.411187:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428577408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790772285.411253:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772285.411322:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428577408 00000100:00100000:1.0:1790772285.411330:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428577408 00000100:00100000:1.0:1790772285.411374:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772285.411383:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428577408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790772285.411414:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790772285.411456:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428577408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772285.411463:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772285.411517:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428577408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790772285.729039:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790772286.433894:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790772286.438478:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772286.438586:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412858752 00000100:00100000:0.0:1790772286.438597:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412858752 00000100:00100000:2.0:1790772286.438652:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 105 00000100:00100000:2.0:1790772286.438665:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+11:13733:x1877760412858752:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772286.438684:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772286.438701:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9aa000/0xdf68d9a7d6a9129b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e5d expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772286.438730:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9aa000/0xdf68d9a7d6a9129b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e5d expref: 12 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772286.438741:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9aa000/0xdf68d9a7d6a9129b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e5d expref: 12 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772286.438750:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa000, rc 0) 00000100:00100000:2.0:1790772286.438812:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:13733:x1877760412858752:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 149us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772286.438819:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 105 00000100:00100000:0.0:1790772286.457221:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772286.457294:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412858880 00000100:00100000:1.0:1790772286.457304:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412858880 00000100:00100000:1.0:1790772286.457357:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 106 00000100:00100000:1.0:1790772286.457367:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:13733:x1877760412858880:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772286.457648:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:13733:x1877760412858880:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 282us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772286.457657:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 106 00000100:00100000:0.0:1790772286.479945:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772286.480097:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412859008 00000100:00100000:3.0:1790772286.480107:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412859008 00000100:00100000:3.0:1790772286.480169:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 107 00000100:00100000:3.0:1790772286.480179:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:13733:x1877760412859008:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772286.480379:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:13733:x1877760412859008:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 201us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772286.480388:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 107 00000100:00100000:2.0:1790772286.505788:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772286.505897:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412859136 00000100:00100000:0.0:1790772286.505907:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412859136 00000100:00100000:0.0:1790772286.505963:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 108 00000100:00100000:0.0:1790772286.505974:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+12:13733:x1877760412859136:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772286.506000:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772286.506018:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a912a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e64 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772286.506044:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a912a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e64 expref: 13 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772286.506055:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df240031200/0xdf68d9a7d6a912a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e64 expref: 13 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772286.506063:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031200, rc 0) 00000100:00100000:0.0:1790772286.506116:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13733:x1877760412859136:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 144us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772286.506131:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 108 00000100:00100000:0.0:1790772286.521766:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772286.521821:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412859264 00000100:00100000:2.0:1790772286.521831:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412859264 00000100:00100000:2.0:1790772286.521886:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:2.0:1790772286.521896:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13733:x1877760412859264:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790772286.522202:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13733:x1877760412859264:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 306us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772286.522221:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:2.0:1790772286.527876:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772286.528006:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412859392 00000100:00100000:1.0:1790772286.528016:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412859392 00000100:00100000:1.0:1790772286.528069:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 110 00000100:00100000:1.0:1790772286.528078:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13733:x1877760412859392:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790772286.528290:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:13733:x1877760412859392:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 213us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772286.528298:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 110 00010000:00010000:2.0:1790772286.755567:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790772286.882374:0:14344:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790772286.882383:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df258961800 from 10 10000000:01000000:1.0:1790772286.882465:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772286.882506:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a912a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772286.882520:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a912a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772286.882531:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a912a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772286.882571:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428577536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790772286.882640:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772286.882690:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a240 going to sleep for 11 seconds 00000100:00100000:1.0:1790772286.886053:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428577536 00000100:00100000:1.0:1790772286.886068:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428577536 00000100:00100000:1.0:1790772286.886131:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790772286.886140:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+16:14344:x1877760428577536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772286.886170:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772286.886186:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9b9c00/0xdf68d9a7d6a912b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a912a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772286.886212:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9b9c00/0xdf68d9a7d6a912b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a912a9 expref: 17 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772286.886223:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9b9c00/0xdf68d9a7d6a912b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a912a9 expref: 17 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772286.886231:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9c00, rc 0) 00000100:00100000:1.0:1790772286.886308:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+17:14344:x1877760428577536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (3668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772286.886315:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790772286.886366:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428577536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790772286.886384:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a912a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a912b0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772286.886537:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a912a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a912b0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772286.886622:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27abed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428577664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790772286.886664:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772286.886684:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24315a240 going to sleep for 11 seconds 00000100:00100000:3.0:1790772286.889734:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428577664 00000100:00100000:3.0:1790772286.889746:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428577664 00000100:00100000:3.0:1790772286.889793:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790772286.889801:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+17:14344:x1877760428577664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772286.890067:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+17:14344:x1877760428577664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (3402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772286.890075:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790772286.890121:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27abed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428577664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772286.892459:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428577792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772286.892543:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772286.892608:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a7000 going to sleep for 11 seconds 00000100:00100000:3.0:1790772286.892632:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428577792 00000100:00100000:3.0:1790772286.892638:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428577792 00000100:00100000:3.0:1790772286.892676:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790772286.892683:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+17:14344:x1877760428577792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772286.892877:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+17:14344:x1877760428577792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772286.892894:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790772286.892942:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428577792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790772286.905040:0:16527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790772286.907289:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790772286.907325:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772286.907336:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a912a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a912b0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772286.907349:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df26f9b8c00/0xdf68d9a7d6a912a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a912b0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772286.907358:0:14344:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772286.907360:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df259054800 from 10 10000000:01000000:0.0:1790772286.907363:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772286.907407:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a912b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772286.907415:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a912b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772286.907427:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a912b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772286.907452:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428577920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772286.907513:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772286.907572:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2520bf780 going to sleep for 11 seconds 00000100:00100000:2.0:1790772286.908904:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428577920 00000100:00100000:2.0:1790772286.908918:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428577920 00000100:00100000:2.0:1790772286.908990:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790772286.909000:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+17:14344:x1877760428577920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790772286.909013:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772286.909028:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a912be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a912b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772286.909052:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a912be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a912b7 expref: 18 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772286.909062:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df26f9aa600/0xdf68d9a7d6a912be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a912b7 expref: 18 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772286.909071:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9aa600, rc 0) 00000100:00100000:2.0:1790772286.909181:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+18:14344:x1877760428577920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772286.909188:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790772286.909423:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428577920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790772286.909441:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a912b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a912be expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772286.909465:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a912b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a912be expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772286.909530:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428578048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772286.909579:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772286.909606:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2520bf780 going to sleep for 11 seconds 00000100:00100000:0.0:1790772286.909621:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428578048 00000100:00100000:0.0:1790772286.909625:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428578048 00000100:00100000:0.0:1790772286.909651:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790772286.909658:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+18:14344:x1877760428578048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772286.909888:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+18:14344:x1877760428578048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772286.909895:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790772286.909929:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428578048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790772286.909955:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428578176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772286.910005:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772286.910019:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2520bf780 going to sleep for 11 seconds 00000100:00100000:0.0:1790772286.910032:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428578176 00000100:00100000:0.0:1790772286.910036:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428578176 00000100:00100000:0.0:1790772286.910058:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790772286.910063:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+18:14344:x1877760428578176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790772286.911454:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+18:14344:x1877760428578176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1385us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772286.911464:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790772286.911536:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428578176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790772286.917513:0:16528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790772286.917710:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790772286.917733:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790772286.917746:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a912b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a912be expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772286.917758:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df240030a00/0xdf68d9a7d6a912b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a912be expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772286.917770:0:14344:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790772286.917772:0:14344:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df27f91f800 from 10 10000000:01000000:0.0:1790772286.917775:0:14344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790772286.917809:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031600/0xdf68d9a7d6a912c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772286.917817:0:14344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff8df240031600/0xdf68d9a7d6a912c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772286.917827:0:14344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff8df240031600/0xdf68d9a7d6a912c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772286.917849:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428578304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790772286.917910:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772286.917945:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2520bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1790772286.918514:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428578304 00000100:00100000:3.0:1790772286.918522:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428578304 00000100:00100000:3.0:1790772286.918592:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790772286.918601:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+18:14344:x1877760428578304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772286.918613:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772286.918627:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df142c8e600/0xdf68d9a7d6a912cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf68d9a7d6a912c5 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772286.918648:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df142c8e600/0xdf68d9a7d6a912cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf68d9a7d6a912c5 expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772286.918659:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df142c8e600/0xdf68d9a7d6a912cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf68d9a7d6a912c5 expref: 19 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772286.918668:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df142c8e600, rc 0) 00000100:00100000:3.0:1790772286.918715:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f131dbd3-adf7-4830-81da-ffe0e188139b+19:14344:x1877760428578304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772286.918721:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790772286.918764:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428578304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790772286.918779:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff8df240031600/0xdf68d9a7d6a912c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a912cc expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772286.918787:0:14344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff8df240031600/0xdf68d9a7d6a912c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf68d9a7d6a912cc expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772286.918849:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428578432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772286.918877:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772286.918893:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df2502a7180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772286.918906:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428578432 00000100:00100000:3.0:1790772286.918910:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428578432 00000100:00100000:3.0:1790772286.918932:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790772286.918939:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:14344:x1877760428578432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772286.919183:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:14344:x1877760428578432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772286.919191:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790772286.919222:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428578432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790772286.919251:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428578560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772286.920500:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772286.920523:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df244056600 going to sleep for 11 seconds 00000100:00100000:3.0:1790772286.920561:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428578560 00000100:00100000:3.0:1790772286.920566:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428578560 00000100:00100000:3.0:1790772286.920597:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790772286.920604:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:14344:x1877760428578560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790772286.920766:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:14344:x1877760428578560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772286.920774:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790772286.920823:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f131dbd3-adf7-4830-81da-ffe0e188139b:14344:1877760428578560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790772286.924241:0:16530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790772286.924533:0:14344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790772286.924594:0:14344:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772286.924605:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff8df240031600/0xdf68d9a7d6a912c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a912cc expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772286.924618:0:14344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff8df240031600/0xdf68d9a7d6a912c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf68d9a7d6a912cc expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772287.776328:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772288.040086:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772288.040118:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772288.040197:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772288.040238:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772288.040265:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772288.040293:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772288.040311:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772288.040334:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412860032 00000100:00100000:1.0:1790772288.040344:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412860032 00000100:00100000:1.0:1790772288.040393:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412859648 00000100:00100000:1.0:1790772288.040396:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412859648 00000100:00100000:1.0:1790772288.040426:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:1.0:1790772288.040434:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:2347:x1877760412860032:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772288.040499:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:2347:x1877760412860032:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 66us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772288.040507:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:1.0:1790772288.040523:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:1.0:1790772288.040529:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2347:x1877760412859648:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772288.040588:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2347:x1877760412859648:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 59us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772288.040595:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00080000:1.0:1790772288.040612:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790772288.040782:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412859776 00000100:00100000:0.0:1790772288.040787:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412859776 00000100:00100000:0.0:1790772288.040822:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412860288 00000100:00100000:0.0:1790772288.040825:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412860288 00000100:00100000:0.0:1790772288.040837:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412859904 00000100:00100000:0.0:1790772288.040851:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412859904 00000100:00100000:0.0:1790772288.040868:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412860160 00000100:00100000:0.0:1790772288.040870:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412860160 00000100:00100000:0.0:1790772288.040884:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:0.0:1790772288.040891:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412859776:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772288.040920:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412859776:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 30us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772288.040926:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:0.0:1790772288.040938:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1790772288.040944:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412860288:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772288.040968:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412860288:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 24us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772288.040986:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1790772288.040998:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1790772288.041004:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412859904:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772288.041029:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412859904:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 25us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772288.041034:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1790772288.041045:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:0.0:1790772288.041051:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412860160:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772288.041071:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412860160:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 21us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772288.041076:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:3.0:1790772288.041922:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412859520 00000100:00100000:3.0:1790772288.041932:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412859520 00000100:00100000:3.0:1790772288.041986:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00100000:3.0:1790772288.041995:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:2347:x1877760412859520:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1790772288.042033:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:2347:x1877760412859520:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 40us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772288.042039:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00080000:1.0:1790772288.042606:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790772288.042612:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790772288.800590:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772289.412023:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772289.412202:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412860416 00000100:00100000:2.0:1790772289.412213:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412860416 00000100:00100000:2.0:1790772289.412276:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:2.0:1790772289.412286:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:14390:x1877760412860416:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772289.412314:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772289.412441:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a912d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e6b expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.412511:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa400/0xdf68d9a7d6a912da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.412531:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa400/0xdf68d9a7d6a912da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.412576:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa400/0xdf68d9a7d6a912da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414069:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a912e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414097:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a912e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414109:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a912e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414447:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391000/0xdf68d9a7d6a912e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414457:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391000/0xdf68d9a7d6a912e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414465:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391000/0xdf68d9a7d6a912e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772289.414492:0:14346:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772289.414502:0:14346:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772289.414542:0:14346:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391000/0xdf68d9a7d6a912e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414570:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa400/0xdf68d9a7d6a912da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414577:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa400/0xdf68d9a7d6a912da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414585:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa400/0xdf68d9a7d6a912da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414590:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aa400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772289.414595:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa400/0xdf68d9a7d6a912da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414602:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa400/0xdf68d9a7d6a912da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414614:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07300) 00010000:00010000:2.0:1790772289.414617:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772289.414622:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa400/0xdf68d9a7d6a912da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414628:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aa400/0xdf68d9a7d6a912da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414639:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a912e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414645:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a912e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414660:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a912e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414665:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9aaa00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772289.414668:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a912e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414675:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a912e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414682:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8df24927db00) 00010000:00010000:2.0:1790772289.414685:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772289.414688:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a912e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414694:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9aaa00/0xdf68d9a7d6a912e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414731:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9ab200/0xdf68d9a7d6a912d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e6b expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414745:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391000/0xdf68d9a7d6a912e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e6b expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.414752:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df24927d400) 00010000:00010000:2.0:1790772289.414754:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772289.414756:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241391000, rc 0) 00000100:00100000:2.0:1790772289.414986:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:14390:x1877760412860416:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 2699us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772289.415004:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1790772289.423577:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772289.423667:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412860672 00000100:00100000:2.0:1790772289.423677:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412860672 00000100:00100000:2.0:1790772289.423730:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:2.0:1790772289.423739:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:14390:x1877760412860672:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790772289.423760:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772289.423779:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a912ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e72 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.423849:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a912f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.423864:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a912f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.423874:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a912f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.423889:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a912fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.423896:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a912fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.423903:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a912fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424235:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391600/0xdf68d9a7d6a91304 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424255:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391600/0xdf68d9a7d6a91304 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424262:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391600/0xdf68d9a7d6a91304 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772289.424272:0:14348:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790772289.424452:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a912f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424461:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a912f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424468:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a912f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424474:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772289.424478:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a912f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424486:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a912f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424497:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df24927d400) 00010000:00010000:2.0:1790772289.424499:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772289.424504:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a912f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424510:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a912f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424522:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a912fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424534:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a912fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424541:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a912fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424545:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772289.424596:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a912fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424603:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a912fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424612:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df24927dd00) 00010000:00010000:2.0:1790772289.424614:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772289.424617:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a912fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.424623:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a912fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.425092:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a912ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e72 expref: 10 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.425107:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391600/0xdf68d9a7d6a91304 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e72 expref: 9 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.425115:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df24927d000) 00010000:00010000:2.0:1790772289.425117:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772289.425124:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241391600, rc 0) 00000100:00100000:2.0:1790772289.425194:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:14390:x1877760412860672:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1455us (1659us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790772289.425202:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:0.0:1790772289.436172:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772289.436301:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412860800 00000100:00100000:2.0:1790772289.436315:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412860800 00000100:00100000:2.0:1790772289.436398:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:2.0:1790772289.436410:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:14390:x1877760412860800:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790772289.436601:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:14390:x1877760412860800:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 Request processed in 192us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772289.436609:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:3.0:1790772289.509231:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772289.509882:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412860928 00000100:00100000:0.0:1790772289.509897:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412860928 00000100:00100000:0.0:1790772289.509989:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:0.0:1790772289.510001:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:14396:x1877760412860928:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1790772289.510029:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772289.510059:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a91312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e79 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.510160:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a91319 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.510179:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a91319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.510192:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a91319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.510209:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a91320 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.510217:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a91320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.510223:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a91320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790772289.510642:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790772289.512225:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a91319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512382:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a91319 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512407:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a91319 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512414:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772289.512419:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a91319 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512428:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a91319 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512447:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07300) 00010000:00010000:0.0:1790772289.512451:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772289.512457:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a91319 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512464:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a91319 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512480:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a91320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512487:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a91320 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512493:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a91320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512498:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030e00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772289.512502:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a91320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512517:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a91320 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512525:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df254043900) 00010000:00010000:0.0:1790772289.512528:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772289.512531:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a91320 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.512537:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a91320 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.513277:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a91312 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e79 expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.513293:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07300) 00010000:00010000:0.0:1790772289.513296:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772289.513300:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a91312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e79 expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.513312:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031c00, rc 0) 00000100:00100000:0.0:1790772289.513413:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:14396:x1877760412860928:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 3413us (4192us total) trans 0 rc 301/301 00000100:00100000:0.0:1790772289.513424:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:0.0:1790772289.518145:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772289.518287:0:14355:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412861056 00000100:00100000:2.0:1790772289.518300:0:14355:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412861056 00000100:00100000:2.0:1790772289.518368:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:2.0:1790772289.518380:0:14355:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:14396:x1877760412861056:12345-192.168.206.27@tcp:700:lfs.0 00000100:00100000:2.0:1790772289.518497:0:14355:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:14396:x1877760412861056:12345-192.168.206.27@tcp:700:lfs.0 Request processed in 119us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772289.518505:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:1.0:1790772289.522665:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772289.522783:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412861312 00000100:00100000:2.0:1790772289.522796:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412861312 00000100:00100000:2.0:1790772289.522869:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:2.0:1790772289.522881:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:14396:x1877760412861312:12345-192.168.206.27@tcp:36:lfs.0 00010000:00010000:2.0:1790772289.522956:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772289.523001:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f200/0xdf68d9a7d6a91255 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226df4 expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.523059:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07300) 00010000:00010000:2.0:1790772289.523065:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772289.523803:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.523822:0:14348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e56 expref: 5 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.523832:0:14348:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.523875:0:14348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e56 expref: 5 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.523893:0:14348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e56 expref: 5 pid: 14348 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772289.523911:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14348:1877760428578688:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772289.524050:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df252011300 going to sleep for 11 seconds 00000100:00100000:3.0:1790772289.527529:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772289.527717:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14348:1877760428578688:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772289.527752:0:14348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772289.527834:0:14332:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412861440 00000100:00100000:0.0:1790772289.527844:0:14332:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412861440 00010000:00010000:0.0:1790772289.527892:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e56 expref: 6 pid: 14348 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772289.527973:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:0.0:1790772289.527985:0:14332:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:2348:x1877760412861440:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772289.528008:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772289.528016:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e56 expref: 6 pid: 14348 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.528028:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e56 expref: 6 pid: 14348 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.528054:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9128d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e56 expref: 6 pid: 14348 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.528074:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07300) 00010000:00010000:0.0:1790772289.528081:0:14332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.528092:0:14332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.528100:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.528125:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772289.528616:0:14332:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2348:x1877760412861440:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 630us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772289.528627:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00010000:00010000:3.0:1790772289.529962:0:14348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.529991:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.530039:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.530055:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.530067:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772289.536127:0:14348:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790772289.536152:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.536165:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.536173:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.536180:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772289.536186:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.536208:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.536229:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df247e07300) 00010000:00010000:3.0:1790772289.536233:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772289.536239:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.536246:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91327 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772289.536273:0:14348:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bdd1c1fe reply state 0000000095d13a24 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772289.536283:0:14348:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772289.536420:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+10:14396:x1877760412861312:12345-192.168.206.27@tcp:36:lfs.0 Request processed in 13536us (13760us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790772289.536442:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00010000:00010000:0.0:1790772289.545881:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.545920:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.545929:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.545936:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8ee00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:0.0:1790772289.545941:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.546087:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.546112:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df247e07200) 00010000:00010000:0.0:1790772289.546116:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790772289.546122:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772289.546129:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ee00/0xdf68d9a7d6a9132e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772289.635682:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772289.635804:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412861568 00000100:00100000:1.0:1790772289.635817:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412861568 00000100:00100000:1.0:1790772289.635887:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:1.0:1790772289.635898:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:14404:x1877760412861568:12345-192.168.206.27@tcp:101:lctl.0 00010000:00010000:1.0:1790772289.635932:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772289.635980:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e80 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.636071:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a9133c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.636096:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a9133c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.636109:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a9133c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772289.636151:0:14347:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790772289.636154:0:14347:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772289.636203:0:14347:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a9133c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.636231:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e80 expref: 11 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.636264:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8600/0xdf68d9a7d6a9133c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e80 expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.636296:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df27c001500) 00010000:00010000:1.0:1790772289.636299:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790772289.636303:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8600, rc 0) 00000100:00100000:1.0:1790772289.636389:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+10:14404:x1877760412861568:12345-192.168.206.27@tcp:101:lctl.0 Request processed in 492us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772289.636397:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:3.0:1790772289.666676:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772289.666806:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412861696 00000100:00100000:2.0:1790772289.666820:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412861696 00000100:00100000:2.0:1790772289.666900:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:2.0:1790772289.666912:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:14405:x1877760412861696:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772289.666959:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772289.666997:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e87 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.667095:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a9134a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.667112:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a9134a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.667126:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a9134a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772289.667169:0:14348:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790772289.667174:0:14348:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772289.667415:0:14348:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a9134a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.667444:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e87 expref: 7 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.667467:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390a00/0xdf68d9a7d6a9134a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e87 expref: 6 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.667477:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df27c001500) 00010000:00010000:2.0:1790772289.667480:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790772289.667484:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241390a00, rc 0) 00000100:00100000:2.0:1790772289.667632:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:14405:x1877760412861696:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 722us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772289.667640:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:0.0:1790772289.673522:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772289.678133:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412861824 00000100:00100000:3.0:1790772289.678151:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412861824 00000100:00100000:3.0:1790772289.678489:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:3.0:1790772289.678502:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:14405:x1877760412861824:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772289.678529:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772289.678576:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a91351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e8e expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.678659:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a91358 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.678679:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a91358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.678691:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a91358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.678718:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a9135f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.678726:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a9135f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.678733:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a9135f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679142:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a91366 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679177:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a91366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679189:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a91366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772289.679231:0:14346:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772289.679235:0:14346:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772289.679251:0:14346:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a91366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679264:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a91358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679271:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a91358 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679278:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a91358 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679284:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8f400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772289.679289:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a91358 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679296:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a91358 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679307:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df27c001500) 00010000:00010000:3.0:1790772289.679310:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772289.679314:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a91358 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679329:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a91358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679348:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a9135f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679353:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a9135f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679359:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a9135f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679364:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8e000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772289.679367:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a9135f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679373:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a9135f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679380:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df247e07300) 00010000:00010000:3.0:1790772289.679382:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772289.679385:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a9135f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.679390:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a9135f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.683170:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a91351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e8e expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.683229:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a91366 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e8e expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.683239:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df247e07700) 00010000:00010000:3.0:1790772289.683242:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772289.683245:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df142c8ec00, rc 0) 00000100:00100000:3.0:1790772289.683363:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+7:14405:x1877760412861824:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 4863us (9851us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772289.683372:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:0.0:1790772289.700330:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772289.700538:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412862080 00000100:00100000:1.0:1790772289.700574:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412862080 00000100:00100000:1.0:1790772289.700636:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:1.0:1790772289.700646:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+7:14405:x1877760412862080:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772289.700666:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772289.700685:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9136d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e95 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772289.700792:0:14347:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790772289.700914:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9136d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e95 expref: 9 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.700927:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df27c001500) 00010000:00010000:1.0:1790772289.700930:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772289.700935:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9136d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e95 expref: 9 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.700950:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9800, rc 0) 00000100:00100000:1.0:1790772289.701024:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+8:14405:x1877760412862080:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 380us (706us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1790772289.701046:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:1.0:1790772289.708201:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772289.708350:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412862336 00000100:00100000:3.0:1790772289.708360:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412862336 00000100:00100000:3.0:1790772289.708424:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:3.0:1790772289.708435:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+8:14405:x1877760412862336:12345-192.168.206.27@tcp:36:lfs.0 00010000:00010000:3.0:1790772289.708488:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772289.708512:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a91366 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e8e expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.708533:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df247e07700) 00010000:00010000:3.0:1790772289.708543:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772289.708621:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.708635:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.708644:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772289.708856:0:14346:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d9b3ec8c reply state 000000009541eedb transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772289.708866:0:14346:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790772289.708874:0:14346:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790772289.708956:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+9:14405:x1877760412862336:12345-192.168.206.27@tcp:36:lfs.0 Request processed in 522us (765us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1790772289.708973:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 24 00010000:00010000:1.0:1790772289.714621:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.714642:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.714651:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.714657:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8e400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772289.714662:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.714670:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.714685:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df247e07300) 00010000:00010000:1.0:1790772289.714689:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790772289.714694:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.714700:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e400/0xdf68d9a7d6a9137b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772289.723097:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772289.734071:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412862592 00000100:00100000:0.0:1790772289.734101:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412862592 00000100:00100000:0.0:1790772289.734176:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:0.0:1790772289.734187:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+8:14405:x1877760412862592:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1790772289.734483:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+9:14405:x1877760412862592:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 297us (11410us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790772289.734521:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:0.0:1790772289.743690:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772289.758866:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412862848 00000100:00100000:2.0:1790772289.758883:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412862848 00000100:00100000:2.0:1790772289.758982:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:2.0:1790772289.758993:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb341af7-d0c4-44fd-ace0-14263cdbead7+9:14405:x1877760412862848:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772289.759029:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772289.759059:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91382 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226e9c expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759167:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a91389 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759186:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a91389 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759199:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a91389 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759216:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a91390 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759224:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a91390 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759232:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a91390 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772289.759374:0:14348:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790772289.759491:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a91389 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759500:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a91389 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759528:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a91389 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759534:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772289.759539:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a91389 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759581:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a91389 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759596:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df27c001500) 00010000:00010000:2.0:1790772289.759599:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772289.759605:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a91389 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759611:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a91389 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759628:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a91390 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759635:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a91390 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759642:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a91390 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759646:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772289.759649:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a91390 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759666:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a91390 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759676:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df24927dd00) 00010000:00010000:2.0:1790772289.759679:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772289.759682:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a91390 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759689:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a91390 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759763:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91382 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e9c expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759777:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df27c001500) 00010000:00010000:2.0:1790772289.759779:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772289.759783:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91382 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226e9c expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.759795:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241390800, rc 0) 00000100:00100000:2.0:1790772289.759893:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb341af7-d0c4-44fd-ace0-14263cdbead7+10:14405:x1877760412862848:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 901us (16213us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1790772289.759902:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:0.0:1790772289.763415:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772289.763496:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412862976 00000100:00100000:1.0:1790772289.763512:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412862976 00000100:00100000:3.0:1790772289.763882:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:3.0:1790772289.763896:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb341af7-d0c4-44fd-ace0-14263cdbead7+10:14405:x1877760412862976:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1790772289.763921:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772289.763944:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a9139e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ea3 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.764038:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.764053:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.764064:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772289.765214:0:14348:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772289.765224:0:14348:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772289.765247:0:14348:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.765285:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a9139e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ea3 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.765322:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ea3 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.769713:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df247e07700) 00010000:00010000:3.0:1790772289.769725:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790772289.769805:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df142c8e000, rc 0) 00000100:00100000:2.0:1790772289.771870:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb341af7-d0c4-44fd-ace0-14263cdbead7+11:14405:x1877760412862976:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 7964us (8455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772289.771886:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:1.0:1790772289.783257:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772289.783861:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412863104 00000100:00100000:3.0:1790772289.783871:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412863104 00000100:00100000:3.0:1790772289.783920:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:3.0:1790772289.783929:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+11:14405:x1877760412863104:12345-192.168.206.27@tcp:37:lfs.0 00000100:00100000:2.0:1790772289.790713:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+11:14405:x1877760412863104:12345-192.168.206.27@tcp:37:lfs.0 Request processed in 6772us (7453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772289.792390:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:0.0:1790772289.798501:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772289.798885:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412863360 00000100:00100000:1.0:1790772289.798909:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412863360 00000100:00100000:1.0:1790772289.798980:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1790772289.798990:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f903050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+11:14405:x1877760412863360:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:1.0:1790772289.799224:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f903050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+12:14405:x1877760412863360:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 235us (735us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1790772289.799232:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00010000:00010000:2.0:1790772289.824178:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790772289.881072:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772289.881228:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412863488 00000100:00100000:3.0:1790772289.881242:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412863488 00000100:00100000:3.0:1790772289.881532:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:3.0:1790772289.881545:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+10:14411:x1877760412863488:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1790772289.881618:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772289.881648:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a913ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226eaa expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.881727:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a913b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.881743:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a913b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.881759:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a913b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.881800:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8fc00/0xdf68d9a7d6a913ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.881808:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8fc00/0xdf68d9a7d6a913ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.881815:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8fc00/0xdf68d9a7d6a913ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.881930:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e200/0xdf68d9a7d6a913c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.881940:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e200/0xdf68d9a7d6a913c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.881946:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e200/0xdf68d9a7d6a913c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790772289.881992:0:14346:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790772289.881996:0:14346:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790772289.882462:0:14346:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e200/0xdf68d9a7d6a913c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882478:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a913b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882486:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a913b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882494:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a913b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882513:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8f400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772289.882519:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a913b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882527:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a913b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882541:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df27c001500) 00010000:00010000:3.0:1790772289.882545:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772289.882577:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a913b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882585:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a913b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882607:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8fc00/0xdf68d9a7d6a913ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882614:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8fc00/0xdf68d9a7d6a913ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882621:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8fc00/0xdf68d9a7d6a913ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882627:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8fc00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772289.882630:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8fc00/0xdf68d9a7d6a913ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882637:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8fc00/0xdf68d9a7d6a913ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882657:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df247e07100) 00010000:00010000:3.0:1790772289.882660:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772289.882664:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8fc00/0xdf68d9a7d6a913ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882671:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8fc00/0xdf68d9a7d6a913ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882712:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a913ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eaa expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882729:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e200/0xdf68d9a7d6a913c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eaa expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772289.882737:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df247e07700) 00010000:00010000:3.0:1790772289.882740:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790772289.882743:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df142c8e200, rc 0) 00000100:00100000:3.0:1790772289.882833:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+11:14411:x1877760412863488:12345-192.168.206.27@tcp:101:bash.0 Request processed in 1289us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772289.882842:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:3.0:1790772289.888674:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772289.889519:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412863744 00000100:00100000:2.0:1790772289.889535:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412863744 00000100:00100000:2.0:1790772289.889638:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:2.0:1790772289.889650:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+11:14411:x1877760412863744:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1790772289.889678:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772289.889705:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a913c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226eb1 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.889843:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.889860:0:14348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ea3 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.889870:0:14348:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.889914:0:14348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ea3 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.889930:0:14348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ea3 expref: 11 pid: 14348 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772289.889959:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14348:1877760428578816:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772289.890093:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df252011300 going to sleep for 11 seconds 00000100:00100000:0.0:1790772289.905540:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772289.906739:0:16462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412863872 00000100:00100000:1.0:1790772289.906755:0:16462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412863872 00010000:00010000:1.0:1790772289.906829:0:16462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ea3 expref: 12 pid: 14348 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772289.906885:0:16462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:1.0:1790772289.906896:0:16462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb341af7-d0c4-44fd-ace0-14263cdbead7+12:2347:x1877760412863872:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772289.906918:0:16462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772289.906927:0:16462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ea3 expref: 12 pid: 14348 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.906943:0:16462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ea3 expref: 12 pid: 14348 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.906982:0:16462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df247e07700) 00010000:00010000:1.0:1790772289.906989:0:16462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.907000:0:16462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.907032:0:16462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.907058:0:16462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790772289.907142:0:16462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb341af7-d0c4-44fd-ace0-14263cdbead7+12:2347:x1877760412863872:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 247us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772289.907150:0:16462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00010000:00010000:2.0:1790772289.908036:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8e000/0xdf68d9a7d6a913a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ea3 expref: 11 pid: 14348 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772289.908063:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14348:1877760428578816:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772289.908089:0:14348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.908100:0:14348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.908107:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.908138:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.908150:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.908159:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.911631:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.911656:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.911670:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772289.911685:0:14348:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790772289.911738:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.911748:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.911756:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.911763:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391a00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772289.911770:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.916194:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.916221:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df247e07700) 00010000:00010000:2.0:1790772289.916224:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772289.916233:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.916317:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a913cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790772289.916347:0:14348:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e5a77449 reply state 0000000051e8c6fe transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772289.916358:0:14348:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790772289.916433:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a913c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb1 expref: 14 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.916453:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb1 expref: 13 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772289.916484:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:2.0:1790772289.916487:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1790772289.916490:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241390c00, rc 0) 00000100:00100000:2.0:1790772289.916644:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+14:14411:x1877760412863744:12345-192.168.206.27@tcp:101:bash.0 Request processed in 26994us (27981us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1790772289.916654:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 28 00010000:00010000:1.0:1790772289.931624:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.931646:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.931655:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.931661:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772289.931667:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.931677:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.931698:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8df24927dd00) 00010000:00010000:1.0:1790772289.931702:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772289.932077:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.932086:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391c00/0xdf68d9a7d6a913d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772289.950430:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772289.951503:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412864000 00000100:00100000:1.0:1790772289.951519:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412864000 00000100:00100000:1.0:1790772289.951883:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:1.0:1790772289.951898:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+13:14411:x1877760412864000:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1790772289.951930:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772289.951971:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9200/0xdf68d9a7d6a913eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226eb8 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.952067:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.952086:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.952100:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772289.952150:0:14346:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790772289.952167:0:14346:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790772289.952193:0:14346:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.952206:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.952234:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9200/0xdf68d9a7d6a913eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb8 expref: 15 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.952258:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb8 expref: 14 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772289.952286:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:1.0:1790772289.952290:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772289.952294:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8200, rc 0) 00000100:00100000:1.0:1790772289.952384:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+14:14411:x1877760412864000:12345-192.168.206.27@tcp:101:bash.0 Request processed in 489us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772289.952392:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:0.0:1790772289.955898:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772289.957683:0:14349:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412864256 00000100:00100000:2.0:1790772289.957701:0:14349:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412864256 00000100:00100000:2.0:1790772289.957918:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1790772289.957932:0:14349:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+14:14411:x1877760412864256:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:2.0:1790772289.958428:0:14349:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:14411:x1877760412864256:12345-192.168.206.27@tcp:35:bash.0 Request processed in 498us (2541us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1790772289.958438:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:0.0:1790772290.016272:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790772290.016301:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428578944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790772290.016939:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772290.017464:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428579200:0@lo:400:kworker.0 00000100:00100000:3.0:1790772290.017517:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772290.017586:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772290.017593:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428579328:0@lo:400:kworker.0 00000100:00100000:3.0:1790772290.017624:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772290.017679:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428579200 00000100:00100000:3.0:1790772290.017688:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428579200 00000100:00100000:3.0:1790772290.017756:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772290.017765:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428579200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772290.017825:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428579200:12345-0@lo:400:kworker.0 Request processed in 60us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772290.017832:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1790772290.017861:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790772290.017895:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f131dbd3-adf7-4830-81da-ffe0e188139b:3296:1877760428579072:0@lo:400:kworker.0 00000100:00100000:3.0:1790772290.017910:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428579200:0@lo:400:kworker.0 00000100:00100000:0.0:1790772290.017976:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772290.018046:0:14340:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428579072 00000100:00100000:0.0:1790772290.018054:0:14340:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428579072 00000100:00100000:0.0:1790772290.018099:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790772290.018108:0:14340:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3296:x1877760428579072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772290.018313:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428579456:0@lo:400:kworker.0 00000100:00100000:1.0:1790772290.018369:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772290.018416:0:14340:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3296:x1877760428579072:12345-0@lo:400:kworker.0 Request processed in 306us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772290.018425:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790772290.018438:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428579328 00000100:00100000:1.0:1790772290.018446:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428579328 00000100:00100000:1.0:1790772290.018490:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428579456 00000100:00100000:1.0:1790772290.018493:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428579456 00000100:00100000:0.0:1790772290.018514:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790772290.018529:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428579328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772290.018532:0:14347:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790772290.018543:0:14347:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790772290.018631:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428579328:12345-0@lo:400:kworker.0 Request processed in 107us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772290.018639:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790772290.018666:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790772290.018674:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428579456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790772290.018739:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428579456:12345-0@lo:400:kworker.0 Request processed in 66us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772290.018748:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790772290.018970:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428579456:0@lo:400:kworker.0 00000100:00100000:1.0:1790772290.019030:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f131dbd3-adf7-4830-81da-ffe0e188139b:3296:1877760428579072:0@lo:400:kworker.0 00000100:00100000:1.0:1790772290.019038:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2746c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428579584:0@lo:400:kworker.0 00000100:00100000:1.0:1790772290.019071:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772290.019105:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428579584 00000100:00100000:1.0:1790772290.019109:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428579584 00000100:00100000:1.0:1790772290.019135:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790772290.019142:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428579584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790772290.019518:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428578944 00000100:00100000:2.0:1790772290.019524:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428578944 00000100:00100000:2.0:1790772290.019582:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790772290.019593:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428578944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790772290.019633:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772290.019696:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1877760428578944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772290.019705:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772290.019802:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1877760428578944:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790772290.020085:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790772290.020092:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790772290.020124:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428579328:0@lo:400:kworker.0 00000100:00100000:1.0:1790772290.021830:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1877760428579584:12345-0@lo:400:kworker.0 Request processed in 2679us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772290.021846:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790772290.022612:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2746c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1877760428579584:0@lo:400:kworker.0 00000100:00100000:3.0:1790772290.098225:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772290.099032:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412864512 00000100:00100000:2.0:1790772290.099043:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412864512 00000100:00100000:2.0:1790772290.099155:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00100000:2.0:1790772290.099166:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:14421:x1877760412864512:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1790772290.099201:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772290.099220:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a913f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ebf expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772290.099324:0:14348:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790772290.099436:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a913f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ebf expref: 17 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.099449:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df27c001500) 00010000:00010000:2.0:1790772290.099452:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772290.099457:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a913f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ebf expref: 17 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.099471:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241390800, rc 0) 00000100:00100000:2.0:1790772290.099531:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14421:x1877760412864512:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 368us (1319us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1790772290.099539:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00080000:3.0:1790772290.102209:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790772290.114470:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772290.114719:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412864768 00000100:00100000:3.0:1790772290.114730:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412864768 00000100:00100000:3.0:1790772290.114785:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:3.0:1790772290.114795:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14421:x1877760412864768:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:3.0:1790772290.115206:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+17:14421:x1877760412864768:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 411us (750us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1790772290.115214:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:0.0:1790772290.175131:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772290.175233:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412865024 00000100:00100000:1.0:1790772290.175253:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412865024 00000100:00100000:1.0:1790772290.175323:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:1.0:1790772290.175333:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+17:14424:x1877760412865024:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1790772290.175356:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772290.175376:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a91407 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ec6 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.175467:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9140e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.175480:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9140e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.175492:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9140e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772290.175503:0:14346:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790772290.175665:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a91407 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ec6 expref: 20 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.175996:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9140e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ec6 expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.176006:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:1.0:1790772290.176009:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790772290.176012:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b9800, rc 0) 00000100:00100000:1.0:1790772290.176118:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+19:14424:x1877760412865024:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 786us (998us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1790772290.176141:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:1.0:1790772290.188123:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772290.188206:0:14334:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412865280 00000100:00100000:2.0:1790772290.188216:0:14334:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412865280 00000100:00100000:2.0:1790772290.188290:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:2.0:1790772290.188300:0:14334:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+19:2350:x1877760412865280:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790772290.188315:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772290.188337:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b9800/0xdf68d9a7d6a9140e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ec6 expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.188356:0:14334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:2.0:1790772290.188361:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772290.188433:0:14334:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+18:2350:x1877760412865280:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 135us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772290.188441:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:3.0:1790772290.189222:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772290.189318:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412865152 00000100:00100000:2.0:1790772290.189324:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412865152 00000100:00100000:2.0:1790772290.189365:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:2.0:1790772290.189374:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+18:14424:x1877760412865152:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:2.0:1790772290.189430:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a9141c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.189446:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a9141c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.189455:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a9141c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.189479:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a9141c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.189485:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a9141c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.189491:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a9141c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.189497:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772290.189501:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a9141c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.189507:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a9141c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.189528:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:2.0:1790772290.189531:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790772290.189535:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a9141c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.189540:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a9141c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772290.189609:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+18:14424:x1877760412865152:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 236us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772290.189617:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:3.0:1790772290.192029:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772290.192214:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412865536 00000100:00100000:2.0:1790772290.192222:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412865536 00000100:00100000:2.0:1790772290.192293:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:2.0:1790772290.192304:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+18:14424:x1877760412865536:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1790772290.192507:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+19:14424:x1877760412865536:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 204us (489us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790772290.192515:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:2.0:1790772290.532517:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428579712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790772290.532651:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772290.532753:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428579712 00000100:00100000:2.0:1790772290.532763:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428579712 00000100:00100000:2.0:1790772290.532840:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772290.532853:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428579712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772290.532902:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790772290.532969:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428579712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772290.532992:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772290.533074:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428579712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772290.557117:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772290.557168:0:16574:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412865792 00000100:00100000:0.0:1790772290.557181:0:16574:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412865792 00000100:00100000:0.0:1790772290.557267:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:0.0:1790772290.557280:0:16574:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+19:14455:x1877760412865792:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:0.0:1790772290.557311:0:16574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772290.557338:0:16574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a91423 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ecd expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772290.557462:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9142a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772290.557479:0:16574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9142a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772290.557492:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9142a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772290.557505:0:16574:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790772290.557766:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a91423 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ecd expref: 22 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772290.557788:0:16574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9142a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ecd expref: 21 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772290.557815:0:16574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:0.0:1790772290.557819:0:16574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772290.557823:0:16574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031c00, rc 0) 00000100:00100000:0.0:1790772290.557897:0:16574:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+21:14455:x1877760412865792:12345-192.168.206.27@tcp:101:cat.0 Request processed in 619us (787us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1790772290.557905:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:0.0:1790772290.580709:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772290.580774:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772290.580811:0:16462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412866176 00000100:00100000:0.0:1790772290.580824:0:16462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412866176 00000100:00100000:0.0:1790772290.580899:0:16462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:0.0:1790772290.580911:0:16462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+21:2350:x1877760412866176:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790772290.580976:0:16462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772290.581009:0:16462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9142a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ecd expref: 21 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772290.581046:0:16462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:0.0:1790772290.581053:0:16462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772290.581121:0:16462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+20:2350:x1877760412866176:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 212us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772290.581131:0:16462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:1.0:1790772290.581413:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412866048 00000100:00100000:1.0:1790772290.581419:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412866048 00000100:00100000:1.0:1790772290.581453:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:1.0:1790772290.581460:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+20:14455:x1877760412866048:12345-192.168.206.27@tcp:35:cat.0 00000100:00100000:1.0:1790772290.581855:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+21:14455:x1877760412866048:12345-192.168.206.27@tcp:35:cat.0 Request processed in 395us (1157us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1790772290.581863:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000001:00080000:2.0:1790772290.630896:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:2.0:1790772290.630917:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:2.0:1790772290.630923:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1790772290.630931:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000100:00100000:3.0:1790772290.632685:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772290.632798:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412866432 00000100:00100000:2.0:1790772290.632810:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412866432 00000100:00100000:2.0:1790772290.632881:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:2.0:1790772290.632891:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+13:14461:x1877760412866432:12345-192.168.206.27@tcp:101:dd.0 00010000:00010000:2.0:1790772290.632922:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772290.632948:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91438 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ed4 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.633089:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.633106:0:14348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb1 expref: 14 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.633116:0:14348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb8 expref: 14 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.633124:0:14348:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.633166:0:14348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb8 expref: 14 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.633202:0:14348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb8 expref: 14 pid: 14346 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772290.633219:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14348:1877760428579840:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772290.633351:0:14348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb1 expref: 14 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.633362:0:14348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb1 expref: 14 pid: 14348 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772290.633370:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14348:1877760428579968:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772290.633398:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24518ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1790772290.638917:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772290.639034:0:14334:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412866560 00000100:00100000:3.0:1790772290.639065:0:14334:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412866560 00010000:00010000:3.0:1790772290.639116:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb8 expref: 15 pid: 14346 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772290.639165:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:3.0:1790772290.639175:0:14334:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2757eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:2348:x1877760412866560:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772290.639194:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772290.639201:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb8 expref: 15 pid: 14346 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.639215:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb8 expref: 15 pid: 14346 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.639242:0:14334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:3.0:1790772290.639248:0:14334:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.639259:0:14334:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.639265:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772290.639346:0:14334:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2757eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:2348:x1877760412866560:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 171us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772290.639355:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:3.0:1790772290.639738:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772290.639762:0:16462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412866688 00000100:00100000:3.0:1790772290.639767:0:16462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412866688 00010000:00010000:3.0:1790772290.639789:0:16462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb1 expref: 15 pid: 14348 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772290.639830:0:16462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:3.0:1790772290.639837:0:16462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:2347:x1877760412866688:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772290.639847:0:16462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772290.639853:0:16462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb1 expref: 15 pid: 14348 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.639862:0:16462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb1 expref: 15 pid: 14348 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.639877:0:16462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:3.0:1790772290.639880:0:16462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.639889:0:16462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.639897:0:16462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.639917:0:16462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772290.639948:0:16462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:2347:x1877760412866688:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 111us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772290.639955:0:16462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00010000:00010000:2.0:1790772290.640213:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8200/0xdf68d9a7d6a913f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb8 expref: 14 pid: 14346 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772290.640235:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14348:1877760428579840:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772290.640249:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a913dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226eb1 expref: 13 pid: 14348 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772290.640272:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14348:1877760428579968:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772290.640302:0:14348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.640312:0:14348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.640328:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772290.640351:0:14348:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790772290.640626:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91438 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ed4 expref: 14 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.640643:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391a00/0xdf68d9a7d6a9143f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ed4 expref: 13 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.640651:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:2.0:1790772290.640654:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790772290.640657:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241391a00, rc 0) 00000100:00100000:2.0:1790772290.640705:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+13:14461:x1877760412866432:12345-192.168.206.27@tcp:101:dd.0 Request processed in 7815us (8029us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1790772290.640713:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:3.0:1790772290.644770:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772290.645600:0:16574:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412866944 00000100:00100000:0.0:1790772290.645613:0:16574:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412866944 00000100:00100000:0.0:1790772290.645693:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:0.0:1790772290.645724:0:16574:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+13:14461:x1877760412866944:12345-192.168.206.27@tcp:36:dd.0 00010000:00010000:0.0:1790772290.646096:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772290.646119:0:16574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772290.646132:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790772290.646193:0:16574:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1790772290.646235:0:16574:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000004b89189 reply state 000000001736cfdf transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772290.646244:0:16574:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790772290.646601:0:16574:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14461:x1877760412866944:12345-192.168.206.27@tcp:36:dd.0 Request processed in 877us (1840us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1790772290.646610:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00000020:00080000:0.0:1790772290.646617:0:16574:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790772290.650021:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772290.650143:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412867072 00000100:00100000:3.0:1790772290.650156:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412867072 00000100:00100000:3.0:1790772290.650297:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:3.0:1790772290.651036:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14461:x1877760412867072:12345-192.168.206.27@tcp:101:dd.0 00010000:00010000:3.0:1790772290.651070:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772290.651097:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a91454 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226edb expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.651179:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a91454 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226edb expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.651196:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a91454 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226edb expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772290.651222:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:3.0:1790772290.651225:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790772290.651230:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df142c8ec00, rc 0) 00000100:00100000:3.0:1790772290.652443:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+17:14461:x1877760412867072:12345-192.168.206.27@tcp:101:dd.0 Request processed in 308us (1310us total) trans 0 rc 0/0 00010000:00010000:1.0:1790772290.654091:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.654111:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.654120:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.654126:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772290.654132:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.654141:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.654163:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:1.0:1790772290.654166:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790772290.654172:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.654208:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a9144d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772290.660023:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:3.0:1790772290.685112:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772290.687437:0:14334:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412867328 00000100:00100000:2.0:1790772290.687456:0:14334:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412867328 00000100:00100000:2.0:1790772290.687620:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:2.0:1790772290.687631:0:14334:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14461:x1877760412867328:12345-192.168.206.27@tcp:103:dd.0 00010000:00010000:2.0:1790772290.687652:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772290.687683:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8ec00/0xdf68d9a7d6a91454 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226edb expref: 16 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.687710:0:14334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:2.0:1790772290.687734:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772290.687813:0:14334:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:14461:x1877760412867328:12345-192.168.206.27@tcp:103:dd.0 Request processed in 184us (2714us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772290.687822:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:2.0:1790772290.695666:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772290.695778:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412867456 00000100:00100000:1.0:1790772290.695791:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412867456 00000100:00100000:1.0:1790772290.695869:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:1.0:1790772290.695880:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:14461:x1877760412867456:12345-192.168.206.27@tcp:58:dd.0 00010000:00010000:1.0:1790772290.696022:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.696045:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772290.696059:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790772290.699898:0:14346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772290.700097:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1790772290.700187:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1790772290.703989:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:14461:x1877760412867456:12345-192.168.206.27@tcp:58:dd.0 Request processed in 8097us (8321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772290.704008:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:0.0:1790772290.709059:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772290.710739:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412867584 00000100:00100000:2.0:1790772290.710758:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412867584 00000100:00100000:2.0:1790772290.710854:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:2.0:1790772290.710866:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:14461:x1877760412867584:12345-192.168.206.27@tcp:101:dd.0 00010000:00010000:2.0:1790772290.710895:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772290.710925:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91462 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ee2 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.711005:0:14348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.711018:0:14348:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91462 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ee2 expref: 16 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.711042:0:14348:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.711056:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91462 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ee2 expref: 16 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.711074:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:2.0:1790772290.711077:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772290.711081:0:14348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91462 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ee2 expref: 16 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772290.711107:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241390800, rc 0) 00000100:00100000:2.0:1790772290.712198:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14461:x1877760412867584:12345-192.168.206.27@tcp:101:dd.0 Request processed in 407us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772290.712209:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00010000:00010000:3.0:1790772290.848362:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790772291.552303:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790772291.552314:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790772291.552390:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790772291.552403:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790772291.552585:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14378:1877760428580096:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790772291.553470:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24518e480 going to sleep for 11 seconds 00000100:00100000:0.0:1790772291.556637:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772291.556981:0:14357:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412867712 00000100:00100000:1.0:1790772291.556993:0:14357:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412867712 00000100:00100000:1.0:1790772291.557062:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:1.0:1790772291.557073:0:14357:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+17:14462:x1877760412867712:12345-192.168.206.27@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790772291.557190:0:14357:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+17:14462:x1877760412867712:12345-192.168.206.27@tcp:900:lhsmtool_posix.0 Request processed in 118us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772291.557198:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:2.0:1790772291.558323:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14378:1877760428580096:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790772291.561873:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772291.562016:0:16574:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412867840 00000100:00100000:0.0:1790772291.562029:0:16574:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412867840 00000100:00100000:0.0:1790772291.562123:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:0.0:1790772291.562151:0:16574:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14462:x1877760412867840:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790772291.562196:0:16574:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790772291.562353:0:16574:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14462:x1877760412867840:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 203us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772291.562361:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:3.0:1790772291.565901:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772291.566635:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412867968 00000100:00100000:2.0:1790772291.566652:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412867968 00000100:00100000:2.0:1790772291.566731:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:2.0:1790772291.566741:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14462:x1877760412867968:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790772291.566838:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91469 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.566859:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91469 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.566874:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91469 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567044:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91470 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567085:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91470 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567098:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91470 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567133:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567142:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567160:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790772291.567203:0:14348:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790772291.567208:0:14348:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790772291.567221:0:14348:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567232:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91469 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567238:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91469 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567245:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91469 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567251:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772291.567256:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91469 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567270:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91469 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567282:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df24927d000) 00010000:00010000:2.0:1790772291.567286:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772291.567290:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91469 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567297:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91469 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567315:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91470 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567321:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91470 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567326:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91470 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567331:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772291.567335:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91470 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567340:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91470 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567347:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8df24927d800) 00010000:00010000:2.0:1790772291.567350:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772291.567352:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91470 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567369:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91470 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567386:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567392:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567397:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567402:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772291.567405:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567411:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567418:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:2.0:1790772291.567420:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772291.567423:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.567428:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a91477 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772291.567706:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14462:x1877760412867968:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 Request processed in 961us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772291.567716:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:3.0:1790772291.571745:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772291.571879:0:16574:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412868224 00000100:00100000:1.0:1790772291.571892:0:16574:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412868224 00000100:00100000:1.0:1790772291.571987:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:1.0:1790772291.571999:0:16574:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:14462:x1877760412868224:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790772291.572055:0:16574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772291.572360:0:16574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9147e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ee9 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572484:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91485 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572503:0:16574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91485 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572516:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91485 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790772291.572528:0:16574:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790772291.572696:0:16574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91485 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572704:0:16574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91485 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572711:0:16574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91485 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572719:0:16574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8000 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772291.572726:0:16574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91485 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572735:0:16574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91485 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572751:0:16574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:1.0:1790772291.572764:0:16574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790772291.572771:0:16574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91485 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572777:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8000/0xdf68d9a7d6a91485 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572833:0:16574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9147e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ee9 expref: 18 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572845:0:16574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df24927d000) 00010000:00010000:1.0:1790772291.572847:0:16574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790772291.572851:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8400/0xdf68d9a7d6a9147e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ee9 expref: 18 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.572861:0:16574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df26f9b8400, rc 0) 00000100:00100000:1.0:1790772291.574412:0:16574:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+17:14462:x1877760412868224:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 2401us (2664us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1790772291.574427:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:3.0:1790772291.583389:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772291.584060:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412868352 00000100:00100000:1.0:1790772291.584074:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412868352 00000100:00100000:1.0:1790772291.584151:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:1.0:1790772291.584162:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+17:14462:x1877760412868352:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790772291.584213:0:14347:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790772291.584381:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+17:14462:x1877760412868352:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 219us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772291.584390:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:3.0:1790772291.589492:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772291.589797:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412868608 00000100:00100000:0.0:1790772291.589811:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412868608 00000100:00100000:0.0:1790772291.589887:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:0.0:1790772291.589898:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+17:14462:x1877760412868608:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772291.589925:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772291.589951:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031800/0xdf68d9a7d6a91493 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ef0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790772291.590935:0:14346:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1790772291.590947:0:14346:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1790772291.591010:0:14346:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1790772291.591314:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9149a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.591334:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9149a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.591347:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9149a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.591420:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031800/0xdf68d9a7d6a91493 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ef0 expref: 20 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.591454:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9149a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ef0 expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.591463:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:0.0:1790772291.591466:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790772291.591470:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030200, rc 0) 00000100:00100000:0.0:1790772291.591626:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+19:14462:x1877760412868608:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1729us (2145us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1790772291.591637:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:3.0:1790772291.606384:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772291.606605:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412868864 00000100:00100000:2.0:1790772291.606619:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412868864 00000100:00100000:2.0:1790772291.606688:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:2.0:1790772291.606699:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+19:14462:x1877760412868864:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790772291.606758:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790772291.606782:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030200/0xdf68d9a7d6a9149a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ef0 expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.606802:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043f00) 00010000:00010000:2.0:1790772291.606813:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790772291.606833:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a914a8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.606846:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a914a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.606855:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a914a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.606930:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc2b9f74f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.606939:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc2b9f74f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.606946:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc2b9f74f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607161:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a914a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607178:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a914a8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607184:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a914a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607190:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772291.607194:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a914a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607202:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a914a8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607211:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df247e07700) 00010000:00010000:2.0:1790772291.607213:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772291.607217:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a914a8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607222:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a914a8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607233:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc2b9f74f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607239:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc2b9f74f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607245:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc2b9f74f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607250:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772291.607260:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc2b9f74f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607266:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914af lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc2b9f74f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607274:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc2b9f74f (ffff8df24927d800) 00010000:00010000:2.0:1790772291.607276:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772291.607279:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914af lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc2b9f74f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.607285:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc2b9f74f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772291.607396:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+18:14462:x1877760412868864:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 699us (1022us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790772291.607404:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:3.0:1790772291.612907:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772291.617891:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412868992 00000100:00100000:0.0:1790772291.617911:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412868992 00000100:00100000:0.0:1790772291.618790:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:0.0:1790772291.618804:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+18:14462:x1877760412868992:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772291.618831:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772291.618861:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031800/0xdf68d9a7d6a914b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226ef7 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.618905:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a914bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.618921:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a914bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.618946:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a914bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.620564:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031800/0xdf68d9a7d6a914b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ef7 expref: 20 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.620624:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030c00/0xdf68d9a7d6a914bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ef7 expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.620635:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043900) 00010000:00010000:0.0:1790772291.620639:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790772291.620643:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030c00, rc 0) 00000100:00100000:0.0:1790772291.620740:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+19:14462:x1877760412868992:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1937us (7845us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772291.620749:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:3.0:1790772291.629432:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772291.629740:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412869248 00000100:00100000:2.0:1790772291.629754:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412869248 00000100:00100000:2.0:1790772291.629823:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:2.0:1790772291.629833:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+19:14462:x1877760412869248:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790772291.629945:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.629978:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.629992:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790772291.630492:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1790772291.630515:0:14347:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 457774964739ns, next at 458774961549ns, rc = 0 00000004:00010000:2.0:1790772291.630659:0:14347:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d83f6172 reply state 00000000c453ce9a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772291.630670:0:14347:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790772291.630793:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+21:14462:x1877760412869248:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 959us (1370us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790772291.630802:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:3.0:1790772291.637218:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772291.637355:0:16574:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412869376 00000100:00100000:0.0:1790772291.637369:0:16574:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412869376 00000100:00100000:0.0:1790772291.637440:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:0.0:1790772291.637451:0:16574:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+21:14462:x1877760412869376:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772291.637481:0:16574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772291.637507:0:16574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a914cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226efe expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.637608:0:16574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a914cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226efe expref: 22 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.637624:0:16574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a914cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226efe expref: 22 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.637648:0:16574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043900) 00010000:00010000:0.0:1790772291.637652:0:16574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790772291.637671:0:16574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031c00, rc 0) 00000100:00100000:0.0:1790772291.637751:0:16574:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+22:14462:x1877760412869376:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 302us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772291.637758:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00010000:00010000:1.0:1790772291.638517:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.638543:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.638597:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.638605:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:1.0:1790772291.638610:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.638619:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.638635:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043900) 00010000:00010000:1.0:1790772291.638638:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790772291.638642:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.638649:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a914c4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772291.643942:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772291.644045:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412869504 00000100:00100000:0.0:1790772291.644058:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412869504 00000100:00100000:0.0:1790772291.644145:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:0.0:1790772291.644157:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412869504:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790772291.644647:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2347:x1877760412869504:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 489us (714us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790772291.644657:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00080000:3.0:1790772291.644934:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790772291.648379:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772291.648603:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412869760 00000100:00100000:1.0:1790772291.648617:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412869760 00000100:00100000:1.0:1790772291.648699:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:1.0:1790772291.648711:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+21:14462:x1877760412869760:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790772291.649014:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+22:14462:x1877760412869760:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 303us (646us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1790772291.649022:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:2.0:1790772291.651684:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772291.651849:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412870016 00000100:00100000:1.0:1790772291.651880:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412870016 00000100:00100000:1.0:1790772291.651947:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:1.0:1790772291.651967:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+22:14462:x1877760412870016:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790772291.652110:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+22:14462:x1877760412870016:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 154us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772291.652117:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:3.0:1790772291.662890:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772291.663159:0:16574:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412870144 00000100:00100000:0.0:1790772291.663174:0:16574:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412870144 00000100:00100000:0.0:1790772291.663264:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:0.0:1790772291.663276:0:16574:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+22:14462:x1877760412870144:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772291.663304:0:16574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772291.663342:0:16574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a914d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226f05 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.663444:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a914d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.663461:0:16574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a914d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.664157:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a914d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790772291.664209:0:16574:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790772291.664429:0:16574:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a914d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16574 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.664469:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031a00/0xdf68d9a7d6a914d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f05 expref: 24 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.664494:0:16574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a914d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f05 expref: 23 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.664505:0:16574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043900) 00010000:00010000:0.0:1790772291.664508:0:16574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790772291.664512:0:16574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030e00, rc 0) 00000100:00100000:0.0:1790772291.664641:0:16574:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+23:14462:x1877760412870144:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1366us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772291.664651:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:0.0:1790772291.667936:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772291.668141:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412870272 00000100:00100000:3.0:1790772291.668154:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412870272 00000100:00100000:3.0:1790772291.668223:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:3.0:1790772291.668441:0:15032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2348:x1877760412870272:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790772291.668466:0:15032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790772291.668493:0:15032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f3868e1/0xdf68d9a7d6a914e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226f0c expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790772291.668526:0:15032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd0443, blocks: 0x1 00010000:00010000:3.0:1790772291.668577:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1790772291.668583:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790772291.668593:0:15032:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f3868e1/0xdf68d9a7d6a914e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f0c expref: 7 pid: 15032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.668614:0:15032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f3868e1/0xdf68d9a7d6a914e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f0c expref: 7 pid: 15032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.668630:0:15032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df142c8fc00, rc 0) 00000100:00100000:3.0:1790772291.668713:0:15032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:2348:x1877760412870272:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 480us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772291.668721:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:3.0:1790772291.676750:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772291.676820:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412870528 00000100:00100000:1.0:1790772291.676833:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412870528 00000100:00100000:1.0:1790772291.676903:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:1.0:1790772291.676915:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+23:14462:x1877760412870528:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790772291.677078:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+23:14462:x1877760412870528:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 166us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772291.677087:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:1.0:1790772291.688357:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772291.688485:0:16574:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412870656 00000100:00100000:0.0:1790772291.688499:0:16574:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412870656 00000100:00100000:0.0:1790772291.688631:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:0.0:1790772291.688643:0:16574:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+23:14462:x1877760412870656:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790772291.785467:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1790772291.785505:0:5845:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1790772291.785531:0:5845:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1790772291.786623:0:16574:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+14:14462:x1877760412870656:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 Request processed in 97972us (98268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772291.786637:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:3.0:1790772291.786852:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790772291.786872:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27ae0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428580224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790772291.786948:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772291.787389:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428580224 00000100:00100000:0.0:1790772291.787399:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428580224 00000100:00100000:0.0:1790772291.787473:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790772291.787482:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428580224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790772291.787900:0:15029:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790772291.787905:0:15029:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1790772291.787907:0:15029:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790772291.787910:0:15029:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790772291 -> 1790772291 00002000:00010000:0.0:1790772291.787913:0:15029:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790772291.790035:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1877760428580224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2542us (3075us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790772291.790051:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1790772291.792214:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df27ae0c380/2, rc 0, transno 8589934595 00000100:00100000:3.0:1790772291.792345:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27ae0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428580224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790772291.796612:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772291.798999:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412870784 00000100:00100000:0.0:1790772291.799029:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412870784 00000100:00100000:0.0:1790772291.799116:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1790772291.799128:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:2347:x1877760412870784:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790772291.799302:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:2347:x1877760412870784:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 Request processed in 176us (2700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772291.799310:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1790772291.802904:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772291.803150:0:14348:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412871040 00000100:00100000:3.0:1790772291.803163:0:14348:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412871040 00000100:00100000:3.0:1790772291.803250:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:3.0:1790772291.803262:0:14348:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27ae0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+14:14462:x1877760412871040:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790772291.803653:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772291.803688:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0xdf68d9a7d6a914d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f05 expref: 14 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.803714:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043900) 00010000:00010000:3.0:1790772291.803721:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790772291.803773:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.803790:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.803802:0:14348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790772291.804515:0:14348:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000036c5f106 reply state 00000000091a9011 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772291.804527:0:14348:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790772291.804721:0:14348:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27ae0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:14462:x1877760412871040:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1460us (1827us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1790772291.804750:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:2.0:1790772291.811801:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00010000:00010000:3.0:1790772291.811919:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.811946:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.811963:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.811970:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df142c8f400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:3.0:1790772291.811977:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.811986:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.812006:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043900) 00010000:00010000:3.0:1790772291.812019:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790772291.812025:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.812031:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df142c8f400/0xdf68d9a7d6a914e7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772291.812745:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412871168 00000100:00100000:0.0:1790772291.812762:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412871168 00000100:00100000:0.0:1790772291.812830:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:0.0:1790772291.812842:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:14462:x1877760412871168:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790772291.812865:0:15029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772291.812887:0:15029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x439c9f0e7f226f13 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.812922:0:15029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f3868e1/0xdf68d9a7d6a914e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f0c expref: 8 pid: 15032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.812973:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772291.812978:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772291.812985:0:15029:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 8 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.813041:0:15029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f3868e1/0xdf68d9a7d6a914e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f0c expref: 8 pid: 15032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.813059:0:15029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f3868e1/0xdf68d9a7d6a914e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f0c expref: 8 pid: 15032 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772291.813087:0:15029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15029:1877760428580352:192.168.206.27@tcp:104: 00000100:00100000:0.0:1790772291.813254:0:15029:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df25089a180 going to sleep for 11 seconds 00000100:00100000:3.0:1790772291.817852:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772291.817992:0:15029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15029:1877760428580352:192.168.206.27@tcp:104: 00010000:00010000:0.0:1790772291.818047:0:15029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 8 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772291.818088:0:15029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240030200, rc 0) 00000100:00100000:1.0:1790772291.819677:0:14333:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412871296 00000100:00100000:1.0:1790772291.819692:0:14333:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412871296 00010000:00010000:1.0:1790772291.819752:0:14333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f3868e1/0xdf68d9a7d6a914e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f0c expref: 9 pid: 15032 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772291.819799:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:1.0:1790772291.819810:0:14333:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:2348:x1877760412871296:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790772291.819829:0:14333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790772291.819857:0:14333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f3868e1/0xdf68d9a7d6a914e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f0c expref: 9 pid: 15032 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.819895:0:14333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f3868e1/0xdf68d9a7d6a914e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f0c expref: 9 pid: 15032 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.819922:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f3868e1/0xdf68d9a7d6a914e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f0c expref: 9 pid: 15032 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.819966:0:14333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772291.819972:0:14333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772291.819980:0:14333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 8 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.819992:0:14333:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 8 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.820049:0:14333:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 8 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772291.820066:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14333:1877760428580480:192.168.206.27@tcp:105: 00000100:00100000:0.0:1790772291.821129:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+8:14462:x1877760412871168:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 8280us (9329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772291.821142:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:1.0:1790772291.822123:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26a216240 going to sleep for 11 seconds 00000100:00100000:2.0:1790772291.828899:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772291.828950:0:15032:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412871424 00000100:00100000:2.0:1790772291.828970:0:15032:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412871424 00000100:00100000:3.0:1790772291.829324:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14333:1877760428580480:192.168.206.27@tcp:105: 00010000:00010000:3.0:1790772291.829355:0:14333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790772291.829414:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:2.0:1790772291.829426:0:15032:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+8:2347:x1877760412871424:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790772291.829699:0:15032:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790772291.829704:0:15032:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790772290 00002000:00010000:2.0:1790772291.829706:0:15032:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790772289 00002000:00010000:2.0:1790772291.829709:0:15032:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790772291 -> 1790772290 00002000:00010000:2.0:1790772291.829712:0:15032:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790772291.830531:0:14333:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:2348:x1877760412871296:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 10717us (12684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772291.830588:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:2.0:1790772291.832573:0:15032:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+8:2347:x1877760412871424:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 3124us (3660us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790772291.832592:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:0.0:1790772291.837122:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772291.837354:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412871552 00000100:00100000:1.0:1790772291.837367:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412871552 00000100:00100000:1.0:1790772291.837479:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:1.0:1790772291.837492:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+8:2349:x1877760412871552:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790772291.837628:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.837670:0:15029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 8 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.837680:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772291.837686:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790772291.837691:0:15029:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.837735:0:15029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 8 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772291.837752:0:15029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 8 pid: 15029 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772291.837768:0:15029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26f3e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15029:1877760428580608:192.168.206.27@tcp:104: 00000100:00100000:1.0:1790772291.837910:0:15029:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df26a216240 going to sleep for 11 seconds 00000100:00100000:1.0:1790772291.842850:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772291.842966:0:14334:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412871680 00000100:00100000:3.0:1790772291.842978:0:14334:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412871680 00010000:00010000:3.0:1790772291.843040:0:14334:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 9 pid: 15029 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772291.843091:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:3.0:1790772291.843102:0:14334:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27abed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:2348:x1877760412871680:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772291.843120:0:14334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772291.843147:0:14334:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 9 pid: 15029 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.843164:0:14334:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 9 pid: 15029 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.843206:0:14334:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772291.843211:0:14334:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790772291.843218:0:14334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.843237:0:14334:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.843594:0:14334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772291.843707:0:14334:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27abed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:2348:x1877760412871680:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 605us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772291.843740:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00010000:00010000:2.0:1790772291.843920:0:15029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3ecc98/0xdf68d9a7d6a914ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226f13 expref: 8 pid: 15029 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772291.844016:0:15029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26f3e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15029:1877760428580608:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772291.844052:0:15029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.844064:0:15029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.844073:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.844106:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.844115:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.844124:0:15029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.844133:0:15029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772291.844138:0:15029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.844148:0:15029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.844162:0:15029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.844176:0:15029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a914f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772291.844533:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:2349:x1877760412871552:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 Request processed in 7042us (7419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772291.844542:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:1.0:1790772291.848157:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772291.848386:0:14346:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412871936 00000100:00100000:2.0:1790772291.848400:0:14346:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412871936 00000100:00100000:2.0:1790772291.848530:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:2.0:1790772291.848542:0:14346:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+14:14462:x1877760412871936:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790772291.848685:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a914fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.848710:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a914fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.848723:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a914fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.849185:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.849199:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a914cb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226efe expref: 15 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.849209:0:14346:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.849474:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a914cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226efe expref: 15 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.849492:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a914cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226efe expref: 15 pid: 16574 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772291.849509:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14346:1877760428580736:192.168.206.27@tcp:104: 00000100:00100000:2.0:1790772291.849649:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24518ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1790772291.856600:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772291.856697:0:14332:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412872064 00000100:00100000:3.0:1790772291.856710:0:14332:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412872064 00010000:00010000:3.0:1790772291.856762:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a914cb lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226efe expref: 16 pid: 16574 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772291.856811:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:3.0:1790772291.856822:0:14332:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2745a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:2347:x1877760412872064:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790772291.856840:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790772291.856849:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a914cb lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226efe expref: 16 pid: 16574 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.856865:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a914cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226efe expref: 16 pid: 16574 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.856894:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043900) 00010000:00010000:3.0:1790772291.856901:0:14332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.856914:0:14332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.856923:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.856969:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790772291.857047:0:14332:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:2347:x1877760412872064:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 226us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772291.857089:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00010000:00010000:2.0:1790772291.857534:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031c00/0xdf68d9a7d6a914cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226efe expref: 15 pid: 16574 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772291.857572:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14346:1877760428580736:192.168.206.27@tcp:104: 00010000:00010000:2.0:1790772291.857597:0:14346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.857607:0:14346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.857613:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790772291.857836:0:14346:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1790772291.858211:0:14346:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1790772291.858611:0:14346:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1790772291.858725:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14346:1877760428580864:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790772291.859431:0:14346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772291.859483:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24518e000 going to sleep for 11 seconds 00000100:00100000:3.0:1790772291.861898:0:14351:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428580864 00000100:00100000:3.0:1790772291.861915:0:14351:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428580864 00000100:00100000:3.0:1790772291.862002:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790772291.862025:0:14351:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14346:x1877760428580864:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790772291.862659:0:14351:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14346:x1877760428580864:12345-0@lo:1000:mdt00_000.0 Request processed in 644us (3232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772291.862668:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790772291.862850:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14346:1877760428580864:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790772291.864082:0:14346:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1790772291.864411:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14346:1877760428580992:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790772291.864928:0:14346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772291.864969:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24518ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1790772291.865448:0:14352:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428580992 00000100:00100000:0.0:1790772291.865468:0:14352:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428580992 00000100:00100000:0.0:1790772291.865570:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790772291.865583:0:14352:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14346:x1877760428580992:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790772291.865881:0:14352:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14346:x1877760428580992:12345-0@lo:1000:mdt00_000.0 Request processed in 300us (953us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790772291.865890:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772291.866982:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14346:1877760428580992:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790772291.867034:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867045:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867051:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867056:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391400 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772291.867060:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867067:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867083:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043900) 00010000:00010000:2.0:1790772291.867085:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772291.867090:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867106:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241391400/0xdf68d9a7d6a91503 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867141:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867162:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867169:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867174:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8800 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772291.867177:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867182:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867191:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:2.0:1790772291.867194:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790772291.867259:0:14346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91462 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ee2 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867272:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91462 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ee2 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867281:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91462 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ee2 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.867345:0:14346:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390800/0xdf68d9a7d6a91462 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x439c9f0e7f226ee2 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772291.867358:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df27f8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14346:1877760428581120:192.168.206.27@tcp:105: 00000100:00100000:2.0:1790772291.867452:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8df24518e240 going to sleep for 11 seconds 00010000:00010000:0.0:1790772291.876880:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772291.876978:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df27f8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14346:1877760428581120:192.168.206.27@tcp:105: 00010000:00010000:2.0:1790772291.877009:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877030:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df26f9b8800/0xdf68d9a7d6a9145b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877061:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a9150a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877076:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a9150a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877087:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a9150a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877097:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a9150a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877104:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a9150a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877111:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a9150a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877117:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390200 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772291.877122:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a9150a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877129:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a9150a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877233:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:2.0:1790772291.877237:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790772291.877241:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a9150a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877258:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390200/0xdf68d9a7d6a9150a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877270:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a914fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877276:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a914fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877295:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a914fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877301:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390c00 already unused, calling callback (ffffffffc1f044f0) 00010000:00010000:2.0:1790772291.877304:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a914fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877311:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a914fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877330:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df24927db00) 00010000:00010000:2.0:1790772291.877333:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790772291.877336:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a914fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.877342:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a914fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772291.877634:0:14346:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2745ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+18:14462:x1877760412871936:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 29092us (29487us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1790772291.877645:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00000020:00080000:2.0:1790772291.877652:0:14346:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790772291.878088:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790772291.878094:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790772291.878121:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790772291.878126:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790772291.879494:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772291.879591:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412872192 00000100:00100000:2.0:1790772291.879600:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412872192 00000100:00100000:2.0:1790772291.879657:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:2.0:1790772291.879668:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24311ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+18:14461:x1877760412872192:12345-192.168.206.27@tcp:49:dd.0 00000100:00100000:2.0:1790772291.879801:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24311ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+18:14461:x1877760412872192:12345-192.168.206.27@tcp:49:dd.0 Request processed in 134us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772291.879809:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:0.0:1790772291.886302:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772291.886362:0:14350:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412872448 00000100:00100000:2.0:1790772291.886377:0:14350:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412872448 00000100:00100000:2.0:1790772291.886449:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:2.0:1790772291.886459:0:14350:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+18:14462:x1877760412872448:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790772291.887197:0:14350:0:(mdd_object.c:4189:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790772291.887989:0:14350:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1790772291.888061:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.888079:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.888090:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.888108:0:14350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.888122:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.888129:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772291.888153:0:14350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790772291.888645:0:15563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772291.888653:0:15563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.888661:0:15563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241390c00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772291.888665:0:15563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.888672:0:15563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.888695:0:15563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df254043900) 00010000:00010000:3.0:1790772291.888699:0:15563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790772291.888704:0:15563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.888710:0:15563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241390c00/0xdf68d9a7d6a91511 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772291.888723:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772291.888726:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772291.888735:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772291.889269:0:14350:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+20:14462:x1877760412872448:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 2806us (2972us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1790772291.889280:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000020:00080000:2.0:1790772291.889287:0:14350:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790772292.101267:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772292.101676:0:15035:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412872576 00000100:00100000:1.0:1790772292.101697:0:15035:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412872576 00000100:00100000:1.0:1790772292.101767:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:1.0:1790772292.101778:0:15035:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:2350:x1877760412872576:12345-192.168.206.27@tcp:4:dd.0 00002000:00010000:1.0:1790772292.101840:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abd0442, atime: 0x6abd0441, ctime: 0x6abd0442, blocks: 0x1 00010000:00010000:1.0:1790772292.101860:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a91518 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.101877:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1790772292.101881:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772292.101888:0:15035:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a91518 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.101913:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a91518 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772292.108822:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772292.109465:0:15037:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1790772292.109479:0:15037:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1790772292.110117:0:15037:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412872704 00000100:00100000:3.0:1790772292.110130:0:15037:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412872704 00000100:00100000:2.0:1790772292.110790:0:16579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:2.0:1790772292.110811:0:16579:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:2349:x1877760412872704:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:2.0:1790772292.110861:0:16579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e91972ba/0xdf68d9a7d6a9151f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.110884:0:16579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772292.110889:0:16579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772292.110896:0:16579:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e91972ba/0xdf68d9a7d6a9151f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.110911:0:16579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e91972ba/0xdf68d9a7d6a9151f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772292.115621:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1790772292.115815:0:15037:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1790772292.115831:0:15037:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1790772292.116326:0:15037:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412872832 00000100:00100000:3.0:1790772292.116341:0:15037:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412872832 00000100:00100000:0.0:1790772292.117142:0:16580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:0.0:1790772292.117170:0:16580:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+11:2350:x1877760412872832:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:0.0:1790772292.117218:0:16580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a91526 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772292.117239:0:16580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772292.117245:0:16580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772292.117253:0:16580:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a91526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772292.117271:0:16580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a91526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790772292.239801:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1790772292.239823:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1790772292.239837:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1790772292.240990:0:15035:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1790772292.240997:0:15035:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790772290 -> 1790772291 00002000:00010000:2.0:1790772292.241000:0:15035:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1790772292.241043:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a91518 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.241059:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a91518 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.241070:0:15035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a91518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.241078:0:15035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772292.241085:0:15035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a91518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.241095:0:15035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a91518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.241122:0:15035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a91518 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.241131:0:15035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009807b48d/0xdf68d9a7d6a91518 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772292.241421:0:15035:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+11:2350:x1877760412872576:12345-192.168.206.27@tcp:4:dd.0 Request processed in 139638us (140158us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1790772292.241433:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00002000:00010000:1.0:1790772292.279003:0:16580:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00000001:00080000:3.0:1790772292.279114:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1790772292.279183:0:16580:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:3.0:1790772292.279912:0:16579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e91972ba/0xdf68d9a7d6a9151f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.279930:0:16579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e91972ba/0xdf68d9a7d6a9151f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.279940:0:16579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e91972ba/0xdf68d9a7d6a9151f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.279948:0:16579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391400 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772292.279967:0:16579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e91972ba/0xdf68d9a7d6a9151f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.279978:0:16579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e91972ba/0xdf68d9a7d6a9151f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.280001:0:16579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e91972ba/0xdf68d9a7d6a9151f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.280143:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e91972ba/0xdf68d9a7d6a9151f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.280378:0:16580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a91526 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.280389:0:16580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a91526 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.280398:0:16580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a91526 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.280404:0:16580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240031a00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772292.280415:0:16580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a91526 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.280425:0:16580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a91526 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.280437:0:16580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a91526 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.280444:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6b1a32c/0xdf68d9a7d6a91526 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772292.280670:0:16580:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+6:2350:x1877760412872832:12345-192.168.206.27@tcp:4:dd.0 Request processed in 163497us (165112us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790772292.280682:0:16580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:2.0:1790772292.282449:0:16579:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2349:x1877760412872704:12345-192.168.206.27@tcp:4:dd.0 Request processed in 171632us (173625us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790772292.282463:0:16579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:2.0:1790772292.286492:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772292.286533:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772292.287068:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772292.287365:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1790772292.287538:0:15036:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412872960 00000100:00100000:1.0:1790772292.287577:0:15036:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412872960 00000100:00100000:1.0:1790772292.287650:0:15036:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412873216 00000100:00100000:1.0:1790772292.287654:0:15036:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412873216 00000100:00100000:1.0:1790772292.287675:0:15036:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412873088 00000100:00100000:1.0:1790772292.287678:0:15036:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412873088 00000100:00100000:1.0:1790772292.287697:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:1.0:1790772292.287708:0:15036:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+7:2347:x1877760412872960:12345-192.168.206.27@tcp:4:dd.0 00002000:00010000:1.0:1790772292.287770:0:15036:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6abd0443, atime: 0x6abd0441, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1790772292.287782:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa1c31e0/0xdf68d9a7d6a9152d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.287802:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1790772292.287825:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772292.287833:0:15036:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1c31e0/0xdf68d9a7d6a9152d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.287850:0:15036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa1c31e0/0xdf68d9a7d6a9152d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772292.288276:0:16580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1790772292.288294:0:16580:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+8:2347:x1877760412873216:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:1.0:1790772292.288353:0:16580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a91534 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.288398:0:16580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772292.288402:0:16580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772292.288408:0:16580:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a91534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.288452:0:16580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a91534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772292.289764:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1790772292.290203:0:15035:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412873472 00000100:00100000:0.0:1790772292.290216:0:15035:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412873472 00000100:00100000:0.0:1790772292.290311:0:15035:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412873344 00000100:00100000:0.0:1790772292.290330:0:15035:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412873344 00000100:00100000:0.0:1790772292.290359:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:0.0:1790772292.290369:0:15035:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+10:2347:x1877760412873088:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:0.0:1790772292.290413:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023674eb5/0xdf68d9a7d6a9153b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772292.290435:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772292.290440:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790772292.290447:0:15035:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023674eb5/0xdf68d9a7d6a9153b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772292.290462:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023674eb5/0xdf68d9a7d6a9153b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790772292.374205:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1790772292.379791:0:15036:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1790772292.379803:0:15036:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:2.0:1790772292.379823:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa1c31e0/0xdf68d9a7d6a9152d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.379839:0:15036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1c31e0/0xdf68d9a7d6a9152d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.379850:0:15036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa1c31e0/0xdf68d9a7d6a9152d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.379858:0:15036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b9200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772292.379864:0:15036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa1c31e0/0xdf68d9a7d6a9152d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.379875:0:15036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa1c31e0/0xdf68d9a7d6a9152d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.379902:0:15036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa1c31e0/0xdf68d9a7d6a9152d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.379910:0:15036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa1c31e0/0xdf68d9a7d6a9152d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772292.380081:0:15036:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:2347:x1877760412872960:12345-192.168.206.27@tcp:4:dd.0 Request processed in 92368us (93592us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1790772292.380094:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:2.0:1790772292.380138:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:2.0:1790772292.380152:0:15036:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+14:2347:x1877760412873472:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:2.0:1790772292.380191:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084a76fd3/0xdf68d9a7d6a91542 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.380206:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772292.380211:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790772292.380219:0:15036:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084a76fd3/0xdf68d9a7d6a91542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.380233:0:15036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084a76fd3/0xdf68d9a7d6a91542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790772292.419712:0:16580:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00010000:00010000:1.0:1790772292.419739:0:16580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a91534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.419754:0:16580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a91534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.419784:0:16580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a91534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.419792:0:16580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8800 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772292.419798:0:16580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a91534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.419808:0:16580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a91534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.419832:0:16580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a91534 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.419840:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948a8ef8/0xdf68d9a7d6a91534 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772292.419965:0:16580:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+16:2347:x1877760412873216:12345-192.168.206.27@tcp:4:dd.0 Request processed in 131658us (133411us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790772292.419977:0:16580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1790772292.420029:0:16580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:1.0:1790772292.420042:0:16580:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+15:2348:x1877760412873344:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:1.0:1790772292.420081:0:16580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a91549 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.420096:0:16580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772292.420107:0:16580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790772292.420115:0:16580:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a91549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.420129:0:16580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a91549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790772292.420277:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1790772292.422424:0:15035:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1790772292.422448:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023674eb5/0xdf68d9a7d6a9153b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.422462:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023674eb5/0xdf68d9a7d6a9153b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.422472:0:15035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023674eb5/0xdf68d9a7d6a9153b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.422480:0:15035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030e00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:3.0:1790772292.422485:0:15035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023674eb5/0xdf68d9a7d6a9153b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.422495:0:15035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023674eb5/0xdf68d9a7d6a9153b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.422518:0:15035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023674eb5/0xdf68d9a7d6a9153b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772292.422526:0:15035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023674eb5/0xdf68d9a7d6a9153b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772292.422663:0:15035:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+11:2347:x1877760412873088:12345-192.168.206.27@tcp:4:dd.0 Request processed in 132290us (135591us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1790772292.422674:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000001:00080000:0.0:1790772292.465995:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1790772292.473858:0:15036:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1790772292.473886:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084a76fd3/0xdf68d9a7d6a91542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.473901:0:15036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084a76fd3/0xdf68d9a7d6a91542 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.473911:0:15036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084a76fd3/0xdf68d9a7d6a91542 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.473936:0:15036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241391c00 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:2.0:1790772292.473942:0:15036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084a76fd3/0xdf68d9a7d6a91542 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.473965:0:15036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084a76fd3/0xdf68d9a7d6a91542 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.473988:0:15036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084a76fd3/0xdf68d9a7d6a91542 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772292.473996:0:15036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084a76fd3/0xdf68d9a7d6a91542 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772292.474195:0:15036:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+9:2347:x1877760412873472:12345-192.168.206.27@tcp:4:dd.0 Request processed in 94041us (186824us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790772292.474207:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000001:00080000:2.0:1790772292.504384:0:6704:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:1.0:1790772292.504501:0:16580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a91549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.504520:0:16580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a91549 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.504531:0:16580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a91549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.504539:0:16580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26f9b8200 already unused, calling callback (ffffffffc14c4ac0) 00010000:00010000:1.0:1790772292.504545:0:16580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a91549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.504588:0:16580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a91549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.504611:0:16580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a91549 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772292.504619:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000f10b31/0xdf68d9a7d6a91549 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772292.504767:0:16580:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2348:x1877760412873344:12345-192.168.206.27@tcp:4:dd.0 Request processed in 84723us (215005us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1790772292.504780:0:16580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00010000:00010000:3.0:1790772292.895861:0:14335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790772293.160524:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772293.160603:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772293.160642:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772293.160675:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772293.160703:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772293.160722:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772293.160747:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1790772293.160780:0:14341:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412873600 00000100:00100000:2.0:1790772293.160806:0:14341:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412873600 00000100:00100000:2.0:1790772293.160862:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 122 00000100:00100000:2.0:1790772293.160873:0:14341:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:2347:x1877760412873600:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772293.160976:0:14341:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52d3e879-983d-44e7-9b45-0d4f9cc178a2+13:2347:x1877760412873600:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 105us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772293.160985:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 122 00000100:00100000:2.0:1790772293.161023:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412873984 00000100:00100000:2.0:1790772293.161027:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412873984 00000100:00100000:2.0:1790772293.161058:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412874240 00000100:00100000:2.0:1790772293.161061:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412874240 00000100:00100000:2.0:1790772293.161076:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412873856 00000100:00100000:2.0:1790772293.161079:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412873856 00000100:00100000:2.0:1790772293.161090:0:15029:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412874368 00000100:00100000:2.0:1790772293.161092:0:15029:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412874368 00000100:00100000:2.0:1790772293.161106:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:2.0:1790772293.161112:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412873984:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772293.161143:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27401ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412873984:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 32us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772293.161149:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:2.0:1790772293.161162:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:2.0:1790772293.161168:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412874240:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772293.161192:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412874240:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 24us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772293.161198:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:2.0:1790772293.161221:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:1.0:1790772293.161399:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412873728 00000100:00100000:1.0:1790772293.161404:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412873728 00000100:00100000:1.0:1790772293.161442:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760412874112 00000100:00100000:1.0:1790772293.161446:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760412874112 00000100:00100000:1.0:1790772293.161469:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:1.0:1790772293.161477:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+20:2347:x1877760412873728:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772293.161516:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+20:2347:x1877760412873728:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 41us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772293.161522:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:1.0:1790772293.161534:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:1.0:1790772293.161541:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:2347:x1877760412874112:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1790772293.161598:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+6:2347:x1877760412874112:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 57us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772293.161605:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00080000:1.0:1790772293.161836:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790772293.161842:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790772293.161844:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790772293.162939:0:15029:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412873856:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1790772293.163048:0:15029:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77ee458b-e89d-44eb-8d29-5e9e1ecfc28d+5:2347:x1877760412873856:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 124us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772293.169126:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:0.0:1790772293.169164:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27f9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412874368:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1790772293.169471:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27f9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb341af7-d0c4-44fd-ace0-14263cdbead7+5:2347:x1877760412874368:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 327us (8721us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772293.169482:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:2.0:1790772293.173394:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00010000:00010000:1.0:1790772293.924691:0:14336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790772294.317499:0:16618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1790772294.946178:0:15563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772295.138570:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f131dbd3-adf7-4830-81da-ffe0e188139b:3295:1877760428581248:0@lo:400:kworker.0 00000100:00100000:0.0:1790772295.138667:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772295.138729:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428581760:0@lo:400:kworker.0 00000100:00100000:0.0:1790772295.138761:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772295.138793:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790772295.138799:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428581376:0@lo:400:kworker.0 00000100:00100000:0.0:1790772295.138847:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772295.138865:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428581888:0@lo:400:kworker.0 00000100:00100000:0.0:1790772295.138887:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772295.138919:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428581504:0@lo:400:kworker.0 00000100:00100000:0.0:1790772295.138958:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772295.138978:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772295.138983:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df273eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428581632:0@lo:400:kworker.0 00000100:00100000:3.0:1790772295.139248:0:14342:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428581248 00000100:00100000:3.0:1790772295.139258:0:14342:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428581248 00000100:00100000:3.0:1790772295.139315:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790772295.139326:0:14342:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d3ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3295:x1877760428581248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772295.139391:0:14342:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d3ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f131dbd3-adf7-4830-81da-ffe0e188139b+19:3295:x1877760428581248:12345-0@lo:400:kworker.0 Request processed in 67us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772295.139399:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790772295.139433:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790772295.139443:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df26fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428582016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772295.139471:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772295.139507:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428582016 00000100:00100000:3.0:1790772295.139511:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428582016 00000100:00100000:3.0:1790772295.139579:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772295.139587:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26fad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428582016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790772295.139623:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790772295.139663:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26fad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877760428582016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772295.139669:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1790772295.139687:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790772295.139742:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df26fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1877760428582016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790772295.139797:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428581376 00000100:00100000:3.0:1790772295.139802:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428581376 00000100:00100000:3.0:1790772295.139834:0:15031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428581504 00000100:00100000:3.0:1790772295.139837:0:15031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428581504 00000100:00100000:3.0:1790772295.139849:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790772295.139855:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428581376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772295.139890:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877760428581376:12345-0@lo:400:kworker.0 Request processed in 36us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772295.139897:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790772295.139907:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790772295.139913:0:15031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428581504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772295.139954:0:15031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428581504:12345-0@lo:400:kworker.0 Request processed in 41us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772295.139961:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790772295.139980:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428581760 00000100:00100000:3.0:1790772295.139984:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428581760 00000100:00100000:3.0:1790772295.140025:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428581888 00000100:00100000:3.0:1790772295.140028:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428581888 00000100:00100000:3.0:1790772295.140049:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772295.140056:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428581760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772295.140087:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877760428581760:12345-0@lo:400:kworker.0 Request processed in 33us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772295.140094:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790772295.140105:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790772295.140111:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428581888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790772295.140139:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877760428581888:12345-0@lo:400:kworker.0 Request processed in 28us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772295.140151:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1790772295.140177:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790772295.140181:0:14343:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790772295.140617:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1790772295.140625:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df27ae0c380, transno 8589934595 00000004:00080000:1.0:1790772295.140636:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1790772295.140658:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1877760428581376:0@lo:400:kworker.0 00000100:00100000:1.0:1790772295.140683:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1877760428581888:0@lo:400:kworker.0 00000100:00100000:1.0:1790772295.140694:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f131dbd3-adf7-4830-81da-ffe0e188139b:3295:1877760428581248:0@lo:400:kworker.0 00000100:00100000:1.0:1790772295.140704:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1877760428581760:0@lo:400:kworker.0 00000100:00100000:0.0:1790772295.142397:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772295.142475:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428581504:0@lo:400:kworker.0 00000100:00100000:1.0:1790772295.142718:0:14347:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428581632 00000100:00100000:1.0:1790772295.142726:0:14347:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428581632 00000100:00100000:1.0:1790772295.142774:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790772295.142782:0:14347:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428581632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790772295.142844:0:14347:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877760428581632:12345-0@lo:400:kworker.0 Request processed in 62us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772295.142851:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790772295.143631:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df273eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877760428581632:0@lo:400:kworker.0 00000100:00100000:0.0:1790772295.649118:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790772295.649148:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8df2745a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428582144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790772295.649254:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772295.649405:0:15033:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877760428582144 00000100:00100000:2.0:1790772295.649416:0:15033:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877760428582144 00000100:00100000:2.0:1790772295.649481:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790772295.649493:0:15033:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8df273eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428582144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790772295.649541:0:15033:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1790772295.649623:0:15033:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8df273eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877760428582144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772295.649631:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772295.649801:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8df2745a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1877760428582144:0@lo:13:osp-pre-0-0.0 Debug log: 29287 lines, 29287 kept, 0 dropped, 0 bad.